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PREFACE 


The  Navy  is  formulating  new  visions,  strategies,  and  concepts  that 
capitalize  on  emerging  information- age  technologies  to  provide  its 
warfighters  with  significantly  improved  capabilities  to  meet  the  na¬ 
tional  security  challenges  of  the  twenty-first  century.  A  key  tenet  of 
Joint  Vision  2020  is  that  information  superiority  will  enable  such  new 
operational  concepts  as  network- centric  warfare  that  promise  deci¬ 
sive  advantages  over  future  adversaries.  The  evaluation  of  informa¬ 
tion  superiority  concepts  will  require  new  models  and  measures  that 
capture  the  effects  of  improved  command  and  control  on  informa¬ 
tion  superiority  and,  more  important,  on  combat  outcomes.  This 
report  will  be  of  interest  to  those  involved  with  improving  Navy  tar¬ 
geting,  assessment,  and  information  technology. 

RAND  has  been  asked  to  develop  measures  of  effectiveness  (MOEs) 
that  reflect  the  effects  of  changing  command,  control,  communica¬ 
tions,  computers,  intelligence,  surveillance,  and  reconnaissance 
(C4ISR)  processes  on  combat  outcomes  in  a  network- centric  envi¬ 
ronment.  This  report  presents  analyses  of  two  combat  vignettes — 
one  involving  defense  against  a  combined  ballistic  missile  and  cruise 
missile  threat  and  the  other  involving  detection  and  destruction  of 
time- critical  targets.  Mathematical  relationships  linking  network¬ 
centric  operations,  C4ISR,  combat  operations,  and  combat  outcomes 
in  a  common  framework  have  been  developed.  The  process  intro¬ 
duces  C4ISR  MOEs,  demonstrates  means  of  evaluating  them,  and 
shows  how  they  can  be  linked  to  combat  outcomes. 

This  research  was  conducted  for  the  Assistant  for  Strategic  Planning 
(N6C),  Department  of  the  Navy,  Office  of  the  Chief  of  Naval  Opera- 
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tions,  within  the  Acquisition  and  Technology  Policy  Center  of 
RAND’s  National  Defense  Research  Institute  (NDRI).  NDRI  is  a 
federally  funded  research  and  development  center  sponsored  by  the 
Office  of  the  Secretary  of  Defense,  the  Joint  Staff,  the  unified 
commands,  and  the  defense  agencies. 
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SUMMARY 


The  primary  objective  of  this  work  is  to  create  a  framework  for  devel¬ 
oping  measures  and  metrics  that  adequately  assess  the  impact  of 
varying  command,  control,  communications,  computers,  intelli¬ 
gence,  surveillance,  and  reconnaissance  (C4ISR)  systems  and  proce¬ 
dures  on  comhat  outcomes.  In  the  process,  sample  measures  and 
metrics  are  suggested  to  achieve  this  goal. 

Although  measures  are  simply  bases  or  standards  of  comparison  and 
can  therefore  be  described  qualitatively,  metrics  must  be  mathemat¬ 
ical  expressions  that  allow  us  to  evaluate  not  only  the  relative  effect 
of  alternative  C4ISR  systems  on  combat  outcomes  but  also  the  de¬ 
gree  to  which  one  is  better  or  worse  than  another.  This  argues  for 
strict  mathematical  formulations  that  produce  accurate  results.  It  is 
important  to  note,  however,  that  the  process  reported  in  this  docu¬ 
ment  is  deductive— i.e.,  none  of  the  equations  presented  in  the  text 
was  based  on  experimental  or  operational  data.  Verification,  valida¬ 
tion,  and  calibration  remains  a  task  for  future  work. 

The  framework  and  the  measures  and  metrics  developed  are  demon¬ 
strated  using  a  spreadsheet  model  based  on  techniques  including 
graph  and  complexity  theory,  reliability  theory,  search  theory,  infor¬ 
mation  entropy  theory,  and  queuing  theory.  The  objective  is  to 
demonstrate  a  proof- of- concept  tool  that  can  quickly  generate  sev¬ 
eral  alternatives  based  on  varying  operating  procedures,  network 
connectivity,  and  C4ISR  systems. 
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BACKGROUND 

Traditional  measures  of  effectiveness  (MOEs)  usually  ignore  the 
effects  of  information  and  decisionmaking  on  combat  outcomes.  In 
the  past,  C4ISR  operations  have  been  analyzed  separately  using  mea¬ 
sures  of  performance  (MOPs).  The  effects  of  changes  in  C4ISR 
operations  on  combat  outcomes  have  been  inferred  rather  than 
directly  assessed,  and  therefore  the  quantifiable  link  between  varia¬ 
tions  in  C4ISR  capabilities  and  combat  outcomes  has  been  relatively 
difficult  to  assess. 

Add  to  this  the  assertion  that  a  richly  connected  network  of  C4ISR 
facilities  and  weapon  systems  will  improve  decisionmaking  and 
therefore  favorably  impact  combat  operations  and  the  assessment 
problem  becomes  even  more  complicated.  This  latter  idea  is 
embodied  in  the  concept  of  network-centric  warfare  (NCW). 

Network-Centric  Warfare 

Network-centric  warfare  is  generally  thought  to  be  the  linking  of 
platforms  into  one,  shared  awareness  network  in  order  to  obtain  in¬ 
formation  superiority,  get  inside  the  opponent's  decision  cycle,  and 
end  conflict  quickly.  In  contrast  to  network- centric  operations  or 
warfare,  traditional  warfare  is  considered  to  be  platform-centric.  The 
difference  between  the  two  is  that  in  platform-centric  warfare,  one 
must  mass  force  to  mass  combat  effectiveness  because  each  weapon 
system  acts  independently,  whereas  in  network- centric  warfare  ef¬ 
fects  are  massed,  rather  than  force.  That  is,  weapon  system  em¬ 
ployment  is  “optimized”  to  improve  aggregate  performance,  possibly 
at  the  expense  of  individual  unit  performance. 

The  Framework 

The  framework  adopted  in  this  report  uses  graph  theory  to  assess  the 
value  or  cost  of  connectivity  and  information  theory  to  assess  the 
value  of  collaboration  in  the  context  of  simple  operational  models. 

Graph  theory  can  be  used  to  represent  the  flow  of  data  and  informa¬ 
tion  in  naval  warfare.  It  can  be  used  to  differentiate  full  participants 
in  decisionmaking  from  outside  monitoring.  It  can  also  be  used  to 
represent  the  complexity  of  data  or  information  flow  in  decision  pro- 
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cesses.  Once  data  and  information  pathways  have  been  established, 
the  decisions  to  be  supported  are  determined  and  decision  rules  are 
developed. 

Information  theory  is  used  to  assess  the  “amount”  of  knowledge 
available  in  a  command  and  control  system.  To  do  this,  we  apply  the 
concepts  embodied  in  information  entropy  or  Shannon  entropy. 
Where  uncertainty  exists,  information  entropy  can  be  assessed— 
provided  the  uncertainty  can  be  expressed  as  a  probability.  In  gen¬ 
eral,  entropy  measures  the  amount  of  information  available  in  the 
distribution.  We  use  this  to  make  the  intellectual  leap  to  measuring 
the  knowledge  level  about  the  uncertain  random  variable.  The  addi¬ 
tional  information  made  available  by  collaboration  increases  the  re¬ 
liability  of  situation  assessments,  so  reliability  theory  is  a  useful  tool 
for  studying  collaboration.  In  the  Time-Critical  Target  (TCT)  vi¬ 
gnette,  we  demonstrate  how  a  priori  knowledge  (in  this  case  of  target 
behavior)  can  be  combined  with  knowledge  gained  through  collabo¬ 
ration.  In  the  same  vignette,  we  also  demonstrate  how  knowledge 
improvements  can  be  quantified  in  a  way  meaningful  to  operators. 

Command  and  control  alternatives,  such  as  Cooperative  Engage¬ 
ment  Capability  (CEC),  are  evaluated  in  this  paper  using  simple  sen¬ 
sor  and  weapon  models  to  demonstrate  the  feasibility  of  analyzing 
the  benefits  of  any  improved  information  and  the  cost  of  possible 
information  overload. 

Analysis  Implications  for  NCW 

NCW  is  not  just  about  networks.  Networks  are  necessary  but  are  not 
a  sufficient  ingredient  to  effective  network- centric  operations,  and 
performance  may  or  may  not  improve  significantly  with  increases  in 
network  size.  Instances  may  occur  in  which  burdens  of  network 
complexity  outweigh  gains  of  increased  opportunity  to  collaborate. 

In  addition,  collaboration  is  generally,  but  not  always,  beneficial. 
Among  the  factors  that  affect  the  value  of  collaboration  is  the  knowl¬ 
edge  the  decisionmaking  team  members  possess  about  the  critical 
element(s)  of  the  operation  and  their  level  of  experience  in  acting  as 
a  team.  A  team  capable  of  highly  effective  collaboration  is  not  apt  to 
benefit  appreciably  from  additional  members— regardless  of  the  new 
members'  knowledge. 
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THE  SCENARIO 

The  conflict  hypothesized  involves  a  small  island  country  facing  a 
large  hostile  neighboring  nation  determined  to  annex  the  island.  The 
fact  that  the  primary  attack  routes  are  over  water,  along  with  the 
small  island  country’s  dependence  on  sea  lines  of  communication 
(SLOCs)  and  air  lines  of  communication  (ALOCs),  implies  a  signifi¬ 
cant  naval  component.  Setting  the  conflict  10  years  into  the  future 
provides  time  to  implement  emerging  NCW  concepts  as  well  as  some 
new  Navy  systems. 

The  island’s  strategic  objective  is  to  “hold  on”  against  an  anticipated 
massive  enemy  application  of  force  early  on.  The  enemy  hopes  that 
this  will  force  an  early  capitulation.  At  a  minimum,  the  island  nation 
must  hold  out  until  the  U.S.  intervenes.  Figure  S.l  illustrates  the  sit¬ 
uation  as  the  island  prepares  to  defend  against  an  anticipated  attack. 

U.S.  forces  are  positioned  to  assist  the  island  improve  its  defensive 
posture  against  enemy  missile  attacks.  Two  carrier  battle  groups 
(CVBGs)  will  be  positioned  east  of  the  island.  Cruisers  and  destroy¬ 
ers  will  screen  the  carriers  with  additional  cruisers  assigned  ballistic 


Figure  S.l — Theater  of  Operations 
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missile  defense  duty  off  the  island’s  two  main  ports.  Nuclear- 
powered  attack  submarines  (SSNs)  will  be  assigned  antisubmarine 
warfare  responsibilities  against  enemy  interdiction  submarines. 


CRUISE  MISSILE  AND  BALLISTIC  MISSILE  DEFENSE 

This  first  vignette  examines  the  information  aspects  of  ship  defense 
against  antiship  cruise  missiles  (ASCM)  while  those  ships  conduct 
theater  ballistic  missile  defense  (TBMD).  Once  launched,  cruise 
missiles  and  ballistic  missiles  enter  an  initial  engagement  queue.  If 
no  interceptor  missile  defeats  the  incoming  attack  missiles,  one  of 
two  things  will  occur:  ASCM  leakers  will  join  a  second  queue  to  be 
“serviced”  by  the  Close-In  Weapon  System  (CIWS)  on  board  the 
cruisers  or  ballistic  missile  damage  to  land  targets  will  be  assessed. 

Two  pairs  of  Aegis  cruisers  are  assigned  to  cover  an  area  of  opera¬ 
tions  to  defend  against  enemy  cruise  and  ballistic  missile  attack. 
Given  their  role  in  defending  friendly  territory,  the  cruisers  them¬ 
selves  are  also  likely  to  be  targets,  and  therefore  they  are  prepared  to 
defend  against  such  an  attack. 

Measures  of  Performance  and  Force  Effectiveness 

The  Aegis  cruisers  have  two  (competing)  missions:  prevent  enemy 
ballistic  missiles  from  destroying  key  allied  infrastructure  targets  and 
defend  against  cruise  missile  attacks.  For  both  missions,  the  obvious 
measure  of  success  is  survivability — that  is,  the  fraction  of  the  critical 
infrastructure  targets  that  survive  the  attack  and  the  ‘'fraction''  of  the 
cruisers  that  survive  the  attack. 

What  is  not  known  is  the  attack  distribution  for  ballistic  missiles  and 
cruise  missiles — i.e.,  how  the  enemy  will  schedule  the  attack  to  en¬ 
sure  that  the  friendly  infrastructure  targets  are  destroyed  while  at  the 
same  time  minimizing  interference  from  the  defending  cruisers.  For 
purposes  of  this  analysis,  all  other  factors  are  known.  The  MOP 
therefore  is  the  degree  to  which  the  friendly  commander  “knows"  the 
enemy's  attack  distribution.  Knowing  the  attack  distribution  con¬ 
tributes  directly  to  the  allocation  of  interceptors  and  therefore  to  the 
effective  defense  of  both  the  cruisers  and  the  friendly  infrastructure 
targets. 
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Alternatives 

Aegis  cruiser  radars  cannot  operate  simultaneously  against  cruise 
and  ballistic  missiles;  defensive  responsibilities  must  be  split 
between  the  two  ships.  We  examine  three  alternatives:  operations 
with  divided  duties,  independent  operations  using  a  shared  common 
operating  picture  (COP),  and  coordinated  operations  using  a  coop¬ 
erative  engagement  capability.  Figure  S.2  illustrates  each. 

Platform- Centric  Operations,  Divided  Duties:  The  two  cruisers  op¬ 
erate  almost  autonomously.  That  is,  although  they  remain  in  contact 
with  each  other,  no  mechanism  on  board  either  ship  automatically 
shares  information  on  the  arriving  threat  and/or  firing  solutions  and 
no  central  authority  directs  the  defensive  response.  Both  ships  em¬ 
ploy  a  first-in-first-out  (FIFO)  queue  discipline  policy  for  engaging 
incoming  missiles.  For  cruise  missiles,  this  makes  self-preservation 
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Network-centric:  cooperative  engagement 


NOTE:  The  Aegis  cruisers  operate  in  pairs  with  one  directing  its  SPY-1  radar  to  detect 
and  track  ballistic  missiles,  while  the  other  directs  its  SPY- 1  radar  to  detect  and  track 
ASCMs. 


Figure  S.2— Alternative  Operating  Procedures 
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collective.  This  means  the  ship  designated  to  intercept  cruise  mis¬ 
siles  does  not  give  itself  priority  against  attack. 

Network- Centric  Operations,  Shared  COP:  In  the  shared  COP 
mode,  both  ships  can  see  incoming  ballistic  missiles  and  cruise  mis¬ 
siles.  An  understanding  exists  between  the  two  ships  concerning  the 
nature  of  the  attack.  Connectivity  has  been  extended  so  that  missile 
threat  trajectory  and  arrival  time  information  are  shared  electroni¬ 
cally,  and  in  this  sense  the  two  ships  can  collaborate.  Although  sen¬ 
sor  information  is  shared,  the  two  ships  continue  to  operate  inde¬ 
pendently.  Both  ships  have  cruise  missile  and  ballistic  missile 
defense  responsibilities.  As  a  result,  poor  "queue  discipline”  is  likely 
because  both  ships  may  engage  the  same  missile  or  fail  to  engage  a 
missile  that  might  have  been  engaged  with  better  coordination. 

Network-Centric  Operations,  Cooperative  Engagement:  This  is  the 
most  compelling  option  and  therefore  is  analyzed  most  fully.  Both 
ships  have  access  to  complete  defense  solutions,  and  allocation  of 
ships  to  targets  is  controlled  centrally  by  one  of  the  two  ships  en¬ 
gaged  in  the  operation.  We  depict  a  separate  node  for  this  additional 
function  for  the  controlling  commander.  Not  only  connectivity  is  re¬ 
quired  in  this  case,  but  also  automated  systems  to  assess  the  relevant 
factors  that  go  into  making  the  best  decision.  Both  ships  have  cruise 
missile  and  ballistic  missile  defense  responsibilities,  as  in  the  previ¬ 
ous  case. 

Decisions 

The  decisions  center  on  the  allocation  policy  that  best  protects  both 
cruisers  and  the  critical  infrastructure  targets.  Remaining  invento¬ 
ries  of  SM-2  Standard  missiles  on  board  each  ship  are  critical  to  the 
decision  process.  The  consumption  rate  for  these  missiles  depends 
on  the  length  of  the  time  period,  the  firing  rate,  the  shooting  policy, 
and  the  number  of  ships  engaging  each  enemy  missile.  Dedicated 
anti-cruise  missile  (ACM)  or  anti-ballistic  missile  (ABM)  ships  may 
risk  emptying  their  defensive  magazines  before  the  attack  has  con¬ 
cluded.  To  prevent  this,  the  two  ships  could  then  reverse  roles. 

Platform-Centric,  Divided  Duties:  Only  the  role- switching  decision 
is  modeled  for  this  case.  The  decision  to  switch  or  not  is  made  at  the 
beginning  of  each  period.  The  need  to  switch  roles  is  based  on  re- 
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maining  inventories  of  Standard  missiles  on  either  of  the  defending 
cruisers. 

Network-Centric,  Shared  COP:  Both  ships  act  independently — but 
with  shared  information.  Each  ship  engages  the  targets  it  feels  it  can 
best  intercept.  The  decision  to  engage  an  enemy  missile  is  based 
primarily  on  the  relative  location  of  the  ship  and  the  enemy  missile. 
Consideration  is  also  given  to  remaining  inventories  of  missiles  and 
the  anticipated  attack  arrival  rate  for  the  next  period. 

Network-Centric,  Cooperative  Engagement:  The  decision  to  be 
made  is  which  ship(s)  should  attempt  to  intercept  each  incoming 
cruise  missile  and  how  many  missiles  can  each  “safely”  engage  in 
each  period.  The  difference  between  this  decision  and  the  shared 
COP  case  is  that,  in  this  instance,  a  central  control  authority  makes 
the  decision  based  on  shared  information  from  both  ships.  The 
assignment  of  ship(s)  to  conduct  the  defense  against  cruise  missile 
attack  is  determined  using  a  set  of  decision  rules  based  on  allocating 
ships  to  missiles  to  prolong  the  survivability  of  the  cruisers  while 
maintaining  inventories  of  ACMs  and  ABMs  as  long  as  possible. 


Mathematical  Representations 

Ne^ork  complexity  and  collaboration  are  combined  to  provide  an 
estimate  of  the  number  of  cruise  and  ballistic  missiles  expected  to 
arrive  in  the  next  and  subsequent  periods.  These  estimates  are  then 
used  in  the  allocation  decision  rules.  The  estimates  are  as  follows: 

^b=a-Kcc,a))^+K^jmb 

The  terms  and  are  the  current  estimates  of  the  arrival  rates  of 
attacking  cruise  and  ballistic  missiles  respectively.  K^c  (A.)  repre¬ 
sents  the  knowledge  about  the  attack  distribution  informed  by  the 
complexity  of  the  network  and  the  collaboration  that  has  taken  place. 
The  subscript  v  refers  to  the  case  being  examined  [v  =  1—platform- 
centric,  u  =  2 — COP,  and  v  =  3 — cooperative  engagement).  and 
Xb  are  the  true  attack  distributions  and  ric  and  are  the  attack 
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sizes  for  cruise  and  ballistic  missiles  to  be  launched  over  a  total  of  T 
minutes.  The  knowledge  function  is  bounded  between  0  and  1  with 
Kcc  (X)  =  1  representing  perfect  knowledge.  When  this  occurs,  = 
Xci  and  Xiji=  X}yi  and  when  knowledge  is  poor 

that  Xci  =  nclTdiXid  Xj^f  =  riij/T.  This  last  case  means  our  estimate  is 
that  the  missiles  are  uniformly  distributed  over  the  attack  horizon,  T. 
These  equations  are  the  MOP.  The  effectiveness  measures 
(survivability  of  cruisers  and  infrastructure)  are  assessed  as  a  result  of 
the  decisions  taken  based  on  these  measures. 

A  TIME-CRITICAL  TARGET 

The  second  vignette  focuses  on  the  problem  of  locating  and  destroy¬ 
ing  an  enemy  submarine  Type  877  Kilo  in  a  short  period  of  time.  It  is 
known  in  advance  that  the  Klo  will  leave  port  to  replace  another  en¬ 
emy  submarine  killed  by  a  U.S.  SSN,  and  a  plan  is  devised  to  kill  it 
before  it  can  threaten  the  SLOCs.  Figure  S.3  depicts  the  situation  on 
D+10,  the  day  the  enemy  submarine  leaves  port  en  route  to  a  posi¬ 
tion  north  of  the  friendly  island  to  menace  shipping  along  the  SLOCs. 
On  D+6,  a  Virginia- cleLSS  SSN  begins  a  previously  planned  Intelli- 
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Figure  S.3 — Situation  at  D+10 
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gence,  Surveillance,  and  Reconnaissance  (ISR)  mission  off  the  ene¬ 
my's  coast.  On  D+10,  it  detects  the  Kilo  leaving  port  and  is  able  to 
track  it  as  it  moves  toward  its  final  station.  The  objective  is  to  kill  the 
Kilo  on  the  surface  as  it  emerges  from  the  port  without  revealing  the 
ISR  submarine  or  disrupting  its  mission.  An  F/A-18  fighter  attack 
aircraft  will  be  vectored  to  the  Kilo  and  will  kill  it  using  a  Standoff 
Land-Attack  Missile-Extended  Response  (SLAM-ER)  missile. 


Measures  of  Performance  and  Force  Effectiveness 

The  Joint  Task  Force  Commander  (JTFC)  has  determined  that 
catching  the  Kilo  on  the  surface  and  attacking  it  as  early  as  possible 
can  best  accomplish  his  objective.  The  command  and  control  MOP 
therefore  is  Time  on  Target— Xhe  time  available  to  an  attacking  air¬ 
craft  to  conduct  its  attack  measured  as  the  time  elapsed  between  its 
arriving  on  station  and  the  Kilo  submerging.  The  combat  MOE  is  the 
probability  that  the  SLAM-ER  destroys  the  Kilo. 

Platform-Centric  Operations.  In  this  configuration,  the  ISR  SSN  re¬ 
ports  to  the  operational  commander,  who  would  then  alert  the  two 
CVBGs  in  the  area  that  a  threat  submarine  has  left  port.  An  F/A-18  is 
placed  in  “Alert  5“  status  and  flies  out  to  attack  the  Kilo  from  one  of 
the  CVBGs.  The  ISR  SSN  continues  to  provide  updates  on  the  Kilo 
through  his  operational  commander.  Command  and  control  is  split 
between  the  SSN  and  air  operations  personnel  on  the  carrier.  The 
SSN  may  attack  the  submerging  Kilo  without  notifying  other  units. 
On  the  other  hand,  air  operations  might  determine  that  the  threat 
level  to  the  aircraft  was  becoming  excessive  and  abort  the  mission. 

Network-Centric  Operations.  In  this  case,  the  connectivity  among 
the  participants  is  richer.  The  ISR  submarine  has  two-way  commu¬ 
nications  (via  Link  16)  to  the  carriers  and  the  deploying  aircraft.  The 
controlling  carrier  uses  two-way  communications  with  the  F/A-18  to 
control  its  operation  and  to  confirm  threat  status  updates.  The  F/A- 
18  receives  periodic  target  updates  directly  from  the  ISR  submarine. 
The  command  and  control  architecture  has  the  same  divisions  as  the 
platform-centric  operation  architecture,  but  consequences  of  this 
division  are  considerably  reduced.  For  example,  the  ISR  submarine 
may  still  decide  that  the  Kilo  is  about  to  submerge  and  that  the  air¬ 
craft  cannot  attack  in  time  and  attack  the  Kilo  itself.  However,  with 
communications  directly  to  the  carrier,  and  to  the  aircraft,  the  air- 
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craft  can  be  turned  back  earlier.  Similarly,  if  air  operations  deter¬ 
mines  that  the  threat  to  the  F/A-18  is  excessive  and  it  is  turned  back, 
the  ISR  submarine  can  be  alerted  in  its  next  communication  cycle 
and  therefore  have  more  time  to  attack  the  Kilo  itself. 

Future  Network-Centric  Operations.  The  Navy's  Unmanned  Com¬ 
bat  Aerial  Vehicle  (UCAV)  concept  is  currently  under  consideration 
by  the  Office  of  Naval  Research  (ONR).  UCAVs  are  designed  to  be 
launched  from  a  variety  of  surface  combatants  and  therefore  elimi¬ 
nate  the  burden  of  keeping  an  F/A-18  (and  a  catapult)  on  alert  status 
for  days.  After  the  ISR  submarine  detects  the  Kilo  coming  out  of  port 
it  alerts  all  potential  UCAV  launch  ships.  The  ships  receiving  the 
message  negotiate  to  determine  which  can  get  a  UCAV  to  the  Kilo 
first.  Such  issues  as  who  makes  the  final  selection,  who  determines 
when  sufficient  collaboration  has  occurred,  what  prior  designations 
have  been  made,  what  is  the  polling  frequency,  and  who  determines 
which  combatants  with  UCAVs  are  candidates  are  command  and 
control  procedural  questions  that  must  be  addressed  and  evaluated 
analytically.  A  UCAV  is  then  launched  and  begins  to  fly  out  to  the 
Kilo  Area  of  Uncertainty  (AOU).  The  ISR  submarine  takes  over  con¬ 
trol  of  the  UCAV,  including  weapon  release.  The  command  and  con¬ 
trol  architecture  for  this  case  is  unsettled.  Several  options  are  avail¬ 
able  and  constitute  the  basis  for  conducting  exploratory  analysis  to 
determine  the  effects  of  each  on  combat  outcomes. 


Mathematical  Representations 

As  with  the  missile  defense  vignette,  network  complexity  and  collab¬ 
oration  combine  to  affect  combat  operations.  In  this  case  however, 
the  decision  to  attack  is  based  on  an  assessment  about  the  time  re¬ 
quired  to  get  an  attack  platform  (UCAV  or  F/A-18)  in  position  to 
launch  a  weapon.  The  expected  latency  expression  is  as  follows: 


^cC  - 


1 


i-g(Q 


where  L^c  is  the  expected  time  required  to  get  the  attack  platform  on 
station  given  the  effects  of  collaboration  and  network  complexity. 
Table  S.l  describes  the  terms  in  this  expression.  This  is  the  MOP. 
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Table  S.l 

Definition  of  Terms  for  TCT  MOP 


Term _  Definition 

g(Q  The  complexity  factor  (0  <  g(C)  <  I ).  Measures  the  effects  of 
"information  overload." 

r  The  number  of  entities  (nodes)  participating  in  the  operation. 

dl  The  indegree  of  node  i,  i.e.,  the  number  of  connections  that  termi¬ 
nate  at  node  L 

K j{t)  The  knowledge  gained  from  node  j  (0  <  K j{t)  <  1) . 

(Oy  The  importance  of  node  j.  toy  =  1  if  node  y  is  participating  in  the 
operations  and  toy  =  0.5  if  it  is  not. 

6 y  If  node  i  is  connected  to  node  j,  5y  =  1  otherwise  5y  =  0. 

1  /  X/  The  mean  time  to  complete  the  task  required  at  node  i. 


The  effectiveness  of  the  operation  depends  on  the  probability  that 
the  enemy  submarine  will  be  detected  and  successfully  engaged. 
This  in  turn  depends  upon  the  amount  of  time,  T=S~  L^c,  available 
to  search  and  attack,  where  S  is  the  time  the  submarine  will  sub¬ 
merge,  We  assume  that  the  SLAM-ER  is  sufficiently  effective  so  that 
if  it  detects  a  target,  the  target  is  destroyed  with  certainty.  The  MOE 
therefore  is  based  on  the  search  equation: 


Pd{T)  =  l-e-y'^ , 

where  Pa(.T)  is  the  probability  the  submarine  will  be  detected  in  T 
minutes  or  less.  The  coefficient  y  consists  of  the  geometrical  aspects 
of  the  problem,  such  as  the  AOU,  the  sensor's  field  of  regard,  and  its 
sweep  vddth.  Also,  it  includes  the  information  update  frequency 
from  the  ISR  SSN  and  knowledge  gained  from  external  sources. 

EXPLORATORY  DATA  ANALYSIS  (EDA) 

Changes  in  MOEs  that  result  from  modifying  the  levels  of  input  vari¬ 
ables  are  best  understood  by  using  visualization  techniques.  By 
varying  the  input  variables,  we  can  better  understand  the  structure  of 
the  data  and  the  complex  relationships  between  inputs  and 
MOPs/MOEs.  This  is  most  easily  achieved  by  using  a  single  repre¬ 
sentative  value  for  some  subset  of  inputs — essentially  treating  them 
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as  fixed  and  assigning  two  of  the  input  variables  to  the  x-  and  y-axes. 
Exploration  is  then  conducted  by  interactively  changing  the  fixed  in¬ 
put  values  to  better  understand  the  relationship  between  that  vari¬ 
able,  the  input  variables  shown  on  the  axes,  and  the  resulting  MOE, 
A  complete  EDA  has  three  phases: 

•  Phase  I — an  introductory  visual  exploration:  This  allows  all 
possible  inputs  to  occur  with  equal  probability. 

•  Phase  II— a  focused  analysis:  The  goal  is  to  restrict  the  explo¬ 
ration  to  ranges  of  input  variables  that  are  more  likely  to  occur. 

•  Phase  III — a  full-scale  stochastic  simulation:  The  simulation 
does  not  use  the  expected  value  of  known  distributions,  but 
rather  randomly  draws  from  them  at  each  simulation  replication. 

The  EDA  tool  developed  for  this  study  focuses  on  the  first  two 
phases,  where  important  relationships  are  discovered  and  the  ex¬ 
pected  impact  of  policy  decisions  can  be  made  before  undertaking 
the  more  costly  task  of  simulation. 


CONCLUSION 

We  conclude  as  we  began  by  stressing  the  need  for  new  measures 
and  metrics  that  incorporate  the  effectiveness  of  C4ISR  systems,  pro¬ 
cedures,  and  equipment  and  their  effect  on  combat  outcome.  The 
assertion  is  generally  made  that  a  richly  connected  network  of  C4ISR 
facilities  and  weapon  systems  will  improve  decisionmaking  and 
therefore  favorably  impact  combat  operations.  This  may  be  true,  but 
as  yet  we  have  no  systematic,  universally  accepted  way  to  demon¬ 
strate  the  truth  of  this  claim.  This  report  has  focused  on  the  Navy’s 
early  attempts  at  codifying  one  approach.  Clearly,  much  remains  to 
be  done  before  accepted  practices  can  be  established.  The  work  pre¬ 
sented  here  is  just  a  beginning. 

Networks  and  NCW 

NCW  is  not  just  about  networks.  Networks  are  necessary  but  not 
sufficient  to  ensure  effective  network- centric  operations.  Much  has 
been  made  of  the  relationship  between  the  “size”  of  the  network  and 
its  efficiency.  The  computer  network  analogy  is  often  cited  to  illus- 
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trate  that  a  more  richly  connected  network  ipso  facto  improves 
overall  performance. 

A  somewhat  opposite  claim  is  that  the  larger  the  number  of  connec¬ 
tions  in  an  operational  network,  the  more  likely  individual  nodes  will 
experience  "information  overload."  Both  arguments  are  compelling. 
However,  it  remains  to  be  seen  if  either  is  true  when  applied  to  mili- 
tary  operations. 

In  this  work,  we  suggest  a  way  to  assess  both  the  good  and  bad  effects 
of  complexity  with  no  claim  that  our  representations  are  accurate. 
However,  complexity  alone,  as  defined  by  the  number  of  con¬ 
nections  in  a  network,  is  clearly  not  enough  to  assess  the  effective¬ 
ness  of  network-centric  operations.  The  command  and  control  pro¬ 
cedures  implemented  on  the  network  and  the  quality  and  extent  of 
collaboration  also  play  an  important  role. 

Collaboration  is  expected  to  improve  a  process  by  which  a  team  of 
individuals  work  together  to  achieve  a  common  goal.  We  have  ar¬ 
gued  that  collaboration  is  important  because  it  can  enhance  the  de¬ 
gree  of  shared  awareness  in  a  group  focused  on  solving  a  specific 
problem  or  agreeing  on  a  decision.  Although  we  have  assumed  that 
collaboration  is  generally  beneficial,  we  have  also  recognized  that  it 
is  not  uniformly  beneficial. 

Information  Theory 

Information  theory  is  not  just  a  subset  of  communications  theory,  as 
some  suggest.  Rather  it  contributes  to  several  fields  of  human  en¬ 
deavor,  but,  most  important,  it  applies  to  military  operations.  In  this 
work,  we  rely  on  information  theory  to  assess  the  “amount”  of 
knowledge  available  in  a  command  and  control  system.  To  do  this, 
we  apply  the  important  concept  of  information  entropy  or  Shannon 
entropy. 

The  quality  of  collaboration  is  clearly  related  to  the  knowledge  the 
participants  in  the  decision  team  about  the  uncertain  environment 
in  which  they  operate.  It  is  natural  therefore  to  resort  to  the  knowl¬ 
edge  function,  which  is  derivative  of  information  entropy,  to  assess 
the  effectiveness  of  the  collaboration  between  two  decision  team 
members. 
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Next  Steps 

We  have  stated  repeatedly  that  this  is  but  a  small  first  step  in  the  ef¬ 
fort  to  establish  measures  and  metrics  to  connect  C4ISR  and 
network- centric  operations  to  outcomes  of  combat.  As  a  next  logical 
step,  the  following  areas  should  be  researched: 

•  Improve  understanding  of  network  complexity  and  better  char¬ 
acterize  its  effects. 

•  Improve  understanding  of  the  effects  of  collaboration. 

•  Examine  ways  to  represent  the  multidimensional  effects  of  col¬ 
laboration. 

•  Assess  the  effects  of  information  quality  on  the  effects  of  collabo¬ 
ration. 
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ACRONYMS  AND  TERMS 


ABM 

Anti-ballistic  missile 

ACM 

Anti-cruise  missile 

ALOC 

Air  Line  of  Communication 

AOU 

Area  of  Uncertainty 

ASCM 

Antiship  cruise  missile 

ASW 

Antisubmarine  warfare 

C4ISR 

Command,  Control,  Communications,  Computers, 
Intelligence,  Surveillance,  and  Reconnaissance 

CEC 

Cooperative  Engagement  Capability:  a  capability 
that  combines  data  from  all  platforms  in  an  opera 
tion  and  allows  the  combined  data  to  produce  a 
better  shared  COP 

CG 

Guided  Missile  Cruiser 

CIC 

Command  Information  Center 

CIWS 

Close-In  Weapon  System 

CJTF 

Commander,  Joint  Task  Force 

Collaboration 

A  process  in  which  operational  entities  actively 
share  information  while  working  together  toward 
common  goal 

Complete 

graph 

A  fully  connected  directed  or  undirected  graph 

Complexity 

Having  several  interrelated  parts  as  in  a  network 
with  several  interrelated  operational  entities 
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COP 

CVBG 

CVIC 

Directed 

Graph 

EDA 

Directed 

Edges 

EW 

Exploratory 

Analysis 

FIFO 

GPS 

Graph 

Indegree 
of  a  Node 

Information 

Entropy 

Information 

Superiority 

INS 

IPB 

ISMWG 

ISR 

JTFC 

Kilo 


Common  operating  picture:  a  view  of  the  bat- 
tlespace  shared  by  all  friendly  forces 

Carrier  battle  group 

Carrier  Intelligence  Center 

A  graph  for  which  the  direction  of  the  edges  con¬ 
necting  two  nodes  is  considered 

Exploratory  data  analysis 

Of  a  directed  graph:  arcs  depicting  direction  of  in¬ 
formation  flow  between  nodes;  also  referred  to  as 
"directed  connections” 

Electronic  warfare 

The  analysis  of  a  large  set  of  outcomes  produced  by 
varying  input  parameter  sets 

First-in-first-out  queue  discipline 

Global  Positioning  System 

A  collection  of  nodes  and  connecting  edges  used  to 
represent  a  network 

The  number  of  edges  that  have  that  node  as  their 
terminal  node 

A  measure  of  the  average  amount  of  information  in 
a  probability  distribution.  Also  referred  to  as  Shan¬ 
non  Entropy 

The  ability  to  collect,  process,  and  disseminate  in¬ 
formation  as  needed;  anticipate  the  changes  in  the 
enemy's  information  needs;  and  deny  the  enemy 
the  ability  to  do  the  same 

Inertial  Navigation  System 

Intelligence  Preparation  of  the  Battlespace 

Information  Superiority  Metrics  Working  Group 

Intelligence,  Surveillance,  and  Reconnaissance 

Joint  Task  Force  Commander 

NATO  designation  for  a  Russian  Project  877  Diesel- 
Electric  Submarine 
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Knowledge 


LACM 

Leakers 

Measures 

Metrics 


MODLOC 


MOE 

MOP 

NCO 

NCW 

ONR 

OOC 

Polling 


ROF 

SAM 

Saturation 

SLAM-ER 

SLOG 

SM 

SS 

SSN 


Accumulated  and  processed  information  wherein 
conclusions  are  drawn  from  patterns.  In  this 
report  measured  as  normalized  information 
entropy.  See  mathematical  glossary  below 

Land-Attack  Cruise  Missile 

In  this  context,  enemy  missiles  that  elude  friendly 
defense  systems. 

Standards  for  comparison. 

Mathematical  expressions  that  evaluate  both  the 
relative  effect  of  alternatives  and  the  degree  to 
which  one  is  better  or  worse  than  another. 

Miscellaneous  Operational  Details  Local 
Operations:  fixed,  geographically  defined 
operating  areas 

Measure  of  Effectiveness 
Measure  of  Performance 
Network-Centric  Operations 
Network-Centric  Warfare 
Office  of  Naval  Research 
Out  of  Commission 

Request  from  a  central  authority  for  information  es¬ 
sential  to  selecting  one  of  several  candidates  to 
execute  a  mission 

Ring  of  Fire  (network-centric  approach  to  littoral 
warfare) 

Surface-to-Air  Missile 

A  condition  occurring  when  the  number  of  attacking 
missiles  overwhelms  the  friendly  defenses 

Standoff  Land-Attack  Missile-Extended  Response 

Sea  Line  of  Communication 

Standard  missile 

Attack  submarine 

Nuclear-powered  attack  submarine 
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SSPH 

SSPK 

Task  Force 

TBM 

TBMD 

TCT 

TEL 

UCAV 

V/STOL 


Single-Shot  Probability  of  Hit 

Single-Shot  Probability  of  Kill 

The  nodes  in  the  network  actively  engaged  in  the 
operation 

Theater  {or  Tactical)  Ballistic  Missile 
Theater  Ballistic  Missile  Defense 
Time-Critical  Target 
Transportable-Erector-Launcher 
Unmanned  Combat  Aerial  Vehicle 
Vertical/Short  Takeoff  and  Landing 


GLOSSARY  OF  MATHEMATICAL  TERMS 


This  glossary  records  the  more  important  mathematical  terms  used 
in  the  report.  The  chapter  reference  is  included  because  the  same 
term  may  have  different  meanings  in  each  chapter  it  appears. 


Chapter 


Term 

Definition 

Designation  for  Aegis  cruiser  direct¬ 
ing  its  SPY-1  radar  to  detect  and  track 
ballistic  missiles 

Reference 

3 

Designation  for  Aegis  cruiser  direct¬ 
ing  its  SPY-1  radar  to  detect  and  track 
cruise  missiles 

3 

ric, 

The  total  number  of  launched  cruise 
missiles  and  ballistic  missiles, 
respectively,  that  are  scheduled  to 
“arrive.’' 

3 

II 

Tis  the  total  CM/BM  attack  time  (in 
minutes)  and  t  is  the  number  of 
attack  time  periods  of  duration  t 

3 

^bi 

The  average  arrival  rates  per  minute 
in  time  period  i  for  cruise  and  ballistic 
missiles,  respectively 

3 

XXXV 
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^bi 

The  estimated  average  arrival  rates 
per  minute  in  time  period  i  for  cruise 
and  ballistic  missiles,  respectively 

3 

S  ~~  S  ~ 

The  number  of  cruise  and  ballistic 
missiles,  respectively,  arriving  in  a 
time  period 

3 

Pc 

The  single-shot  probability  that  a 
Standard  missile  intercept  from  an 

Aegis  cruiser  kills  an  attacking  cruise 
missile 

3 

Pk 

The  effective  probability  that  a 

Standard  missile  interceptor  will  kill 
an  attacking  cruise  missile 

3 

Pl=1~Pk 

The  probability  that  an  attacking 
cruise  missile  will  be  a  “leaker" 

3 

Pi  ~PL^ci^ 

The  expected  number  of  leakers  in 
time  period  i 

3 

% 

The  expected  number  of  Standard 
missiles  that  must  be  fired  at  each 
attacking  cruise  missile 

3 

h 

The  number  of  attacking  cruise 
missiles  detected  at  a  given  time 

3 

1 

^  = - 

T1+X2+X3 

The  mean  time  required  for  each 

Aegis  cruiser  to  engage  an  attacking 
missile:  x^  is  the  mean  time  to  pre¬ 
pare  a  launcher,  X2  the  mean  time 
required  to  launch  the  intercept,  and 

X3  the  mean  time  to  fly  out  to  the 
target 

3 

5  =  'Ci  +t2 


The  time  required  to  prepare  a 
Standard  missile  launcher  for  the  next 
launch 
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VoixlV^ix), 

H{x] 

K{X) 

jic)  ric) 

rib)  rib) 

»  ^b 


The  number  of  attacking  cruise  3 

missiles  required  to  destroy  an  Aegis 
cruiser 

The  maximum  or  target  variance  and  3  and 
the  minimum  variance,  respectively,  Appendix 
for  the  fraction  of  remaining  missiles  A 

arriving  in  the  current  time  period 

H{x)  =  E[\n{f{x))]  =  -l'^Jn[fix)]f{x)dx  3 

Information  or  Shannon  entropy.  See 
Acronyms  list  for  definition 

The  degree  to  which  the  attacking  3 

missile  arrival  rate  is  known.  Calcu¬ 
lated  as  the  normalized  H(k) . 

The  minimum  number  of  ACMs  and  3 


ABMs  needed  to  assume  the  role  of 
defense  against  CMs  and  BMs, 
respectively 

The  remaining  inventories  of  ACMs  3 

and  ABMs  onboard 

The  remaining  inventories  of  ACMs  3 

and  ABMs  on  board 

The  number  of  Standard  missiles  3 

required  to  destroy  an  enemy  missile 
if-  c  implies  ACM  and/=  b  implies 
ABM) 

Estimate  of  the  future  attack  if=c  3 

implies  CM  attack  and/=  b  implies 
BM  attack) 

The  number  of  Standard  missiles  A^^^  ^ 

should  launch  against  attacking 
enemy  missiles  of  type/ if  =  c  implies 
CM  attack  and/=  b  implies  BM 
attack) 
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^ f  The  number  of  Standard  missiles 

should  launch  against  attacking 
enemy  missiles  of  type  f{f=c  implies 
CM  attack  and /=  b  implies  BM 
attack) 

E,(c),  E,(b).  of  ACMs  fired 

Ec(b,c) 

Eh(c).  Eh(b).  7*’®. ABMs  fired 

_  ,  by  /I  ,  ,  or  both 

Eiy(b,c) 

1/  Xi  The  mean  time  required  to  ac¬ 

complish  task  i. 

L,Lc,Lcc  The  network  latencies:  base,  with 

collaboration  factored  and  with  both 
collaboration  and  complexity 
factored 


3 

3 

3 

4 

4 


Chapter  One 

INTRODUCTION 


Traditional  measures  of  effectiveness  (MOEs)  usually  ignore  the  ef¬ 
fects  of  information  and  decisionmaking  on  combat  outcomes.  In 
the  past,  command,  control,  communications,  computers,  intelli¬ 
gence,  surveillance,  and  reconnaissance  (C4ISR)  operations  have 
been  analyzed  separately  using  measures  of  performance  (MOPs). 
Assessing  the  effects  of  improvements  in  C4ISR  operations  on  com¬ 
bat  outcomes  has  been  inferred  rather  than  directly  assessed.  For 
example,  such  physical  improvements  as  greater  bandwidth  are  gen¬ 
erally  thought  to  be  beneficial  to  combat  operations.  The  same  is 
true  for  improved  sensors  and  fusion  algorithms  and  their  salutary 
effects  on  the  common  operating  picture  (COP).  Even  the  more  re¬ 
cent  discussions  of  network- centric  warfare  (NCW)  or  network¬ 
centric  operations  (NCO)  (Cebrowski,  1998)  and  information  supe¬ 
riority  imply  that  their  effects  will  be  to  improve  combat  operations 
by  improving  decisionmaking.  However,  the  quantifiable  link  be¬ 
tween  these  improvements  in  C4ISR  and  combat  outcomes  has  been 
relatively  difficult  to  assess.  The  problem  has  been  widely  recog¬ 
nized:  for  example,  Alberts  et  al.  (2001)  state  in  their  recent  book: 

For  many,  Information  Superiority  and  Network  Centric 
Warfare  remain  abstract  concepts,  their  applicability  to  military 
operations  and  organizations  [are]  unclear,  and  their  value 
unproven.  Others  have  seen  the  benefits  but  are  unable  to  "connect 
the  dots”  between  improved  information  .  .  .  and  outcomes  in  a 
[scientifically]  rigorous . . .  way. 
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NCW 

NCW  is  generally  thought  to  be  the  linking  of  platforms  into  one, 
shared  awareness  network  in  order  to  obtain  information  superiority, 
get  inside  the  opponent's  decision  cycle,  and  end  conflict  quickly.  In 
contrast  to  network-centric  operations  or  warfare,  traditional  warfare 
is  considered  to  be  platform-centric.  The  difference  between  the  two 
is  that  in  platform-centric  warfare,  one  must  mass  force  to  mass 
combat  effectiveness  because  each  weapon  system  acts  indepen¬ 
dently,  whereas  in  NCW  effects  are  massed,  rather  than  force.  That 
is,  the  employment  of  weapon  systems  is  optimized  so  that  a  target  is 
serviced  by  the  most  effective  system  in  the  network.^  Thus,  it  is  hy¬ 
pothesized,  the  effects  of  massing  force  can  be  obtained  with  a  much 
smaller  force.  The  Navy  and  the  C4ISR  community  are  pursuing  the 
application  of  this  concept  to  warfare. 

NCW  is  based  on  the  concept  of  three  network  grids: 

•  The  information  network  grid:  The  information  grid  provides  the 
infrastructure  to  “receive,  process,  transport,  store,  and  protect 
information  for  the  loint  and  combined  services”  (Stein,  undated). 

•  The  sensor  network  grid:  The  sensor  grid  is  a  need-based  net¬ 
work  that  uses  the  sensors  in  the  information  grid  pertinent  to  a 
given  task.  It  is  made  up  not  only  of  such  typical  warfare  sensors 
as  radar  but  also  of  imbedded  logistics  sensors  to  track  supply. 
The  sensor  grid  is  unique  to  each  task. 

•  The  engagement- decision-shooter  grid:  Sensor  and  warfighter 
elements  of  the  network  are  tasked  to  attack  in  the  engagement 
grid.  This  grid,  like  the  sensor  grid,  is  dynamic,  using  a  unique 
blend  of  warfighters  and  sensors  for  each  new  task  (Stein,  un¬ 
dated). 

The  latter  two  grids  are  completely  contained  in  the  information 
network  grid.  Each  grid  is  composed  of  nodes  represented  by  indi¬ 
vidual  sensors,  weapons,  or  command  platforms  and  is  connected 
via  networked  data  and  communication.  The  sensor  and  engage- 


^Actually,  the  word  “optimized”  is  a  bit  strong.  "Improved  considerably”  is  closer  to 
the  truth. 
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ment  grids  are  not  necessarily  separate.  They  often  have  overlapping 
components.  For  example,  the  sensor  grid  begins  a  track  on  a  cruise 
missile  and  continues  to  track  as  the  pertinent  unit  engages  and  a  kill 
is  made. 

NCW  flattens  the  command  and  control  pyramid.  Commanders 
communicate  intent  through  the  introduction  of  doctrine  in  the  form 
of  computer  algorithms  as  well  as  communicating  directly  with  indi¬ 
vidual  units.  NCW  moves  toward  automated  optimization  of  the 
positions  of  units  in  a  group  and  engagement  of  enemy  forces  using 
new  initiatives  such  as  the  Navy's  Cooperative  Engagement  Capabil- 
ity2  (CEC)  and  Ring  of  Fire.^ 

OBJECTIVES 

The  primary  objective  of  this  project  is  to  create  a  framework  for  de¬ 
veloping  measures  and  metrics  that  adequately  assess  the  impact  of 
changed  C4ISR  systems  and  procedures  on  combat  outcomes.  In  the 
process,  sample  measures  and  metrics  are  suggested  that  achieve 
this  goal.  These  are  presented  with  the  idea  of  generating  dialogue  in 
the  naval  and  C4ISR  communities  concerning  the  framework  and  the 
measures  and  metrics  suggested.  This  is  clearly  overdue. 

Although  measures  are  simply  bases  or  standards  of  comparison,  and 
can  therefore  be  described  qualitatively,  metrics  must  be  mathemat¬ 
ical  expressions  that  allow  us  to  evaluate,  not  only  the  relative  effect 
of  alternative  C4ISR  systems  on  combat  outcomes,  but  also  the  de¬ 
gree  to  which  one  is  better  or  worse  than  another.  This  argues  for 
rigorous  mathematical  formulations  that  produce  accurate  results.  It 
is  important  to  note,  however,  that  the  process  reported  in  this  doc¬ 
ument  is  deductive — i.e.,  none  of  the  equations  presented  in  the  text 


^CEC  is  designed  is  to  combine  the  raw  sensor  data  from  all  platforms  involved  in  an 
operation,  regardless  of  age  or  type  of  sensors  on  individual  platforms.  It  allows  the 
combined  data  from  these  sources  to  produce  a  more  complete,  shared  COP  for 
tracking  purposes.  For  additional  information  see  “The  Cooperative  Engagement  Ca- 
pabilitY,”  Johns  Hopkins  APL  Technical  Digest,  16/4, 1995. 

^The  Ring  of  Fire  (ROF)  concept  is  a  network-centric  approach  to  littoral  warfare.  It 
links  land,  sea,  and  air  forces  to  produce  calls  for  fire.  Like  the  CEC,  ROF  networks 
sensor  and  weapon  information  for  sea,  shore,  and  command  forces  in  the  littoral  to 
produce  an  extended  and  more  accurate  COP.  See  Mitchell,  R.,  “Naval  Fire  Support: 
Ring  of  Fire,”  US  Naval  Institute  Proceedings,  123/11:54,  November  1997. 
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is  based  on  experimental  or  operational  data.  Validation  and  calibra¬ 
tion  remain  tasks  for  future  work. 

Naval  warfare  covers  a  wide  range  of  disparate  operations  and, 
therefore,  demands  a  variety  of  measures  and  metrics  to  assess  the 
outcomes  analytically.  Consequently,  it  is  important  that  an  analysis 
of  this  kind  encompass  a  variety  of  engagements  to  ensure  the  ade¬ 
quacy  of  the  framework  and  the  metrics  developed.  The  objective 
then  is  to  select  a  single  major  conflict  and  examine  several  vignettes 
within  the  scenario.  The  scenario  selected  was  a  notional  future 
(2010)  conflict  involving  the  defense  of  threatened  allied  territory. 
Two  vignettes  were  selected  for  examination: 

•  Cruise  and  ballistic  missile  attack:  The  first  is  a  coordinated  anti¬ 
ship  cruise  missile  (ASCM)  saturation  strike  against  U.S.  surface 
combatants  and  a  ballistic  missile  attack  against  targets  being 
defended  by  those  surface  combatants.  An  ASCM  attack  might 
prevent  those  ships  from  protecting  against  ballistic  missiles  by 
disabling  a  ship  or  saturating  its  command  and  control  systems  so 
that  ballistic  missiles  can  “leak”  through. 

•  Time-Critical  Targets  (TCTs):  The  classic  TCT  vignette  for  analy¬ 
sis  is  operation  against  a  Transportable-Erector-Launcher  (TEL), 
such  as  an  enemy  Scud  launcher.  However,  the  vignette  selected 
for  analysis  in  this  work  is  the  search  for  and  destruction  of  an 
enemy  submarine  leaving  port  en  route  to  interdict  friendly  ports. 
The  submarine  must  be  destroyed  before  it  submerges. 

Finally,  the  framework  and  the  measure  and  metrics  developed  are 
demonstrated  using  a  spreadsheet  model.  The  objective  is  to  provide 
the  analyst  with  a  proof-of-concept  tool  that  will  quickly  generate 
several  alternatives  based  on  varying  operating  procedures,  network 
connectivity,  and  C4ISR  systems.  The  relative  value  of  the  alterna¬ 
tives  is  assessed  in  terms  of  the  contribution  each  makes  to  combat 
outcomes.  The  contribution  may  be  defined  differently  for  each  vi¬ 
gnette  evaluated.  Seversd  hundred  alternatives  can  be  easily  gener¬ 
ated  using  the  spreadsheet  models,  and  therefore  the  use  of  ex¬ 
ploratory  analysis  as  an  evaluation  tool  is  required.  “Exploratory 
analysis”  refers  to  the  use  of  many  computational  experiments  to 
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reason  about  complex  and  uncertain  problems.  Recently, 
exploratory  approaches  have  been  used  for  a  variety  of  studies.^ 

ABOUT  THIS  REPORT 

Chapter  Two  outlines  the  basic  scenario  developed  to  support  this 
study.  Several  vignettes  were  developed  from  this  scenario,  and  two 
were  singled  out  for  analysis.  Chapter  Three  details  the  first  of  these: 
the  defense  of  allied  territory  and  the  engaged  fleet  against  ballistic 
missile  and  cruise  missile  attack.  Chapter  Four  focuses  on  the  sec¬ 
ond  vignette:  a  TCT  analysis  problem  involving  the  search  for  and 
destruction  of  a  surfaced  enemy  submarine.  Both  Chapters  Three 
and  Four  include  the  mathematical  foundation  for  the  metrics  pro¬ 
posed  to  assess  the  relationships  among  NCW,  improved  command 
and  control  processes,  and  combat  outcome.  Chapter  Five  describes 
the  spreadsheet  model  used  to  conduct  exploratory  analysis  and 
Chapter  Six  concludes  with  some  findings  and  suggestions  for  future 
work.  Two  glossaries  are  included  to  assist  the  reader  with  the  text. 
These  appear  on  pp.  xxxi-xxxviii.  The  first  describes  acronyms  and 
terms  used  in  the  text,  and  the  second  records  the  definitions  of  the 
several  mathematical  terms.  Finally,  an  Information  Entropy 
appendix  is  included. 


^For  a  discussion  of  exploratory  analysis  and  exploratory  modeling,  see  Bankes  (1993) 
and  Davis,  Bigelow,  and  McEver  (2001). 


Chapter  Two 

A  FUTURE  MARITIME  CONFLICT 


The  conflict  hypothesized  involves  a  small  island  country  facing  a 
large  hostile  neighboring  nation  determined  to  annex  the  island.  The 
fact  that  the  primary  attack  routes  are  over  water,  along  Avith  the 
small  island  country’s  dependence  on  sea  lines  of  communications 
(SLOCs)  and  air  lines  of  communications  (ALOCs),  implies  a  signifi¬ 
cant  naval  component.  Setting  the  conflict  10  years  into  the  future 
provides  time  to  implement  emerging  NCW  concepts  as  well  as  some 
new  Navy  systems. 

THE  ENEMr  S  PLAN 

The  scenario  begins  early  in  2009,  as  the  hostile  nation  prepares  to 
attack  the  nearby  island  nation.  By  May  2010,  planning  is  complete 
and  the  enemy  is  ready  to  initiate  operations  against  the  island. 
From  the  enemy’s  perspective,  the  most  favorable  outcome  would  be 
for  the  island  to  capitulate  before  the  United  States  intervenes — as 
the  United  States  has  promised  to  do  in  the  event  serious  hostile  acts 
are  initiated.  An  intense  initial  attack  will  further  the  enemy’s  goal. 
Attacking  before  the  island’s  main  supporter  (the  United  States)  can 
assist  in  its  defense  will  maximize  the  effectiveness  of  the  strike. 

Simultaneity 

A  primary  effect  of  the  attack  is  to  degrade  the  island’s  airfields  and 
command  and  control  facilities.  The  operational  objective  is  to  over¬ 
run  island  air  defenses  early.  The  goal  is  to  maintain  constant  pres¬ 
sure,  thus  preventing  the  island  from  reconstituting  air  superiority. 
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Simultaneously,  an  attempt  is  made  to  cut  the  island's  SLOCs.  This 
is  seen  to  be  useful  in  weakening  the  island  as  the  conflict  continues, 
even  if  the  tactic  were  unsuccessful  in  forcing  capitulation.  The 
island  is  particularly  dependent  on  its  SLOCs  for  fuel.  The  aggressor 
plans  to  declare  an  interdiction  and  launch  an  effort  to  destroy 
several  merchant  vessels  before  the  United  States  can  intervene.  In 
the  (likely)  event  capitulation  does  not  occur  early,  the  interdiction 
will  be  extended  as  part  of  a  war  of  attrition. 

Capitalizing  on  Asymmetries 

Although  the  aggressor's  air  force  is  numerically  superior  to  the  is¬ 
land’s  air  force  in  2010,  the  aggressor  cannot  bring  all  of  its  aircraft  to 
bear  in  any  reasonable  period  of  time.  The  problem  is  that  the  air¬ 
craft  are  widely  dispersed  and  the  command  and  control  capability  is 
undeveloped.  The  aggressor’s  only  leverage  is  that,  unlike  the  island, 
it  can  replace  losses  from  out-of-theater.  The  island's  qualitative  ad¬ 
vantages  in  aircraft  and  crew  training  offset  the  numeric  disadvan¬ 
tage. 

The  aggressor  plans  to  employ  asymmetric  warfare  techniques  de¬ 
veloped  in  the  last  decade  of  the  twentieth  century.  Key  to  its  strat¬ 
egy  is  its  relatively  large  and  capable  submarine  force,  its  missile 
force  (especially  ballistic  missile),  and  a  limited  electronic  warfare 
(EW)  capability. 


The  Aggressor’s  Asymmetric  Advantages 

Submarine  Warfare:  Beginning  in  the  1990s,  partly  as  a  result  of  the 
high-tech  Iraq  war,  the  enemy  recognized  the  value  of  modern,  ca¬ 
pable  forces,  including  submarines,  and  has  since  devoted  consider¬ 
able  resources  to  modernize  its  forces.  The  submarine  force,  how¬ 
ever,  has  been  optimized  for  attacks  against  surface  ships  and  not  for 
antisubmarine  warfare  (ASW).  In  2010,  the  island  still  cannot 
counter  the  enemy  submarines  with  other  submarines,  surface  ships, 
or  aircraft.  As  a  result,  the  enemy  nation  can  apply  pressure  to  the  is¬ 
land  nation's  SLOCs  for  long  periods  without  significant  risk  to  its 
own  submarine  forces. 
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Missiles:  The  enemy  nation  has  developed  a  daunting  missile  chal¬ 
lenge  in  2010  built  on  conventional  theater  ballistic  missiles  and 
land- attack  cruise  missiles.  They  offer  a  means  to  attack  early  those 
assets  most  directly  relating  to  the  island  nation’s  ability  to  sustain 
defensive  operations.  Defense  of  more  than  a  small  fraction  of  the 
island  nation  against  this  threat  is  infeasible.  Used  in  large  numbers 
at  the  outset  of  a  conflict,  these  missiles  could  gain  the  enemy  coun¬ 
try  early  air  superiority  over  the  island  nation. 

Electronic  Warfare:  The  enemy  nation  has  developed  a  significant 
EW  capability  against  the  island  nation’s  warning  radars,  without 
which  it  cannot  intercept  attacking  aircraft  efficiently.  Along  with 
the  aforementioned  missile  advantage,  this  capability  could  help  the 
enemy  nation  achieve  air  superiority  early  in  a  conflict. 

The  Enemy  View 

A  key  problem  for  the  aggressor  in  2010  is  the  dispersion  of  its  air 
forces  and  the  lack  of  a  modern  command  and  control  structure  that 
can  effectively  mass  airpower  in  a  timely  manner.  It  must  also  antic¬ 
ipate  U.S.  involvement  in  any  conflict  with  the  island.  Once  in  the 
fight,  U.S.  forces  can  threaten  much  of  the  aggressor’s  navy.  The  ag¬ 
gressor,  therefore,  plans  to  move  its  navy  into  a  defensive  bastion  to 
protect  all  of  its  high-value  ships. 

We  assume  U.S.  forces  are  located  just  a  few  hundred  miles  from  the 
enemy  nation,  and  less  than  a  thousand  miles  from  the  threatened 
island.  U.S.  Navy  forces  can  be  on  the  scene  in  about  a  day  after  get¬ 
ting  under  way.  The  fact  that  the  United  States  can  become  involved 
this  quickly  influences  the  enemy’s  strategy. 

RESISTANCE  TO  ANNEXATION 

The  island’s  strategic  objective  is  to  “hold  on”  against  an  anticipated 
massive  enemy  application  of  force  early  in  any  conflict.  The  aggres¬ 
sor  hopes  that  its  massive  application  of  force  will  result  in  an  early 
capitulation.  This  would  be  the  worst  possible  outcome  for  the  is¬ 
land  as  a  nation,  and  therefore  it  must  be  prepared  to  weather  such 
an  attack.  At  a  minimum,  the  island  nation  must  plan  to  hold  out 
until  the  United  States  intervenes. 


10  Measures  of  Effectiveness  for  the  Information- Age  Navy 


Although  the  island  cannot  hope  to  defeat  its  enemy  militarily,  it  can 
strive  to  fight  to  a  draw,  with  the  aggressor  tiring  of  the  conflict  and 
seeking  peace.  At  best,  the  aggressor  will  decide  that  the  cost  of  con¬ 
tinuing  the  conflict  (a  war  of  attrition)  would  outweigh  any  possible 
gain,  thus  ending  the  conflict  under  favorable  terms  for  the  island 
nation. 

Operational  Objectives 

The  island  nation’s  primary  objective  is  to  maintain  air  superiority 
over  its  contiguous  waters— at  least  up  to  the  limits  of  the  enemy’s 
surface-to-air  missile  (SAM)  envelope.  This  is  paramount.  It  is  vital 
to  protecting  SLOCs  and  ALOCs  and  deterring  or  defeating  enemy  as¬ 
saults  by  sea  or  air. 

An  important  weapon  for  maintaining  air  superiority  in  the  island 
nation’s  arsenal  is  the  F-16  fighter  aircraft.  Their  pilots  have  been 
trained  in  the  United  States,  and  they  get  considerably  more  flight 
hours  than  their  enemy  counterparts.  Consequently,  the  island  has 
superior  air  force  operational  proficiency.  This  strength  is  enhanced 
by  command  and  control  capabilities  considerably  superior  to  the 
enemy’s  uncoordinated  air  force. 

Geographically,  the  island's  air  superiority  will  cover  all  of  the  island 
and  much  of  the  waters  between  itself  and  the  enemy,  but  it  will  not 
extend  to  the  enemy  coast.  Aircraft  attacking  the  island  must  emerge 
from  overlapping  SAM  coverage  areas  before  they  can  be  engaged. 
However,  the  ALOCs  on  the  island  and  lesser  combatants  can  be 
protected  against  enemy  surface  attacks  on  shipping  near  the  island. 

Figure  2.1  illustrates  the  situation  facing  the  island  as  it  prepares  to 
defend  against  an  anticipated  attack. 

THE  U.S.  ROLE 

U.S.  naval  forces  are  positioned  to  help  the  island  improve  its  de¬ 
fensive  posture  against  enemy  missile  attacks  by  intercepting  mis¬ 
siles  in  flight.  There  is  no  desire  for  the  United  States  to  attack  the 
enemy’s  territory.  U.S.  aircraft  will  position  themselves  to  fill  the 
gaps  in  the  island’s  defense  and  thereby  help  ensure  that  the  island 
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Figure  2.1 — Theater  of  Operations 


nation  achieves  its  primary  objective  of  maintaining  air  superiority 
over  the  island  and  much  of  the  waters  between  itself  and  the  enemy. 

A  consequence  of  the  U.S.  involvement  will  likely  be  to  force  the  ag¬ 
gressor  into  a  defensive  posture,  thus  limiting  its  offensive  options. 


U.S.  Air  and  Sea  Operations 

Initially  the  carrier  battle  group  (CVBG)  operating  nearby  will  be 
positioned  east  of  the  island  with  MODLOC  position  placing  it  out  of 
enemy  reach.  ^  It  is  joined  by  a  second  CVBG  before  the  outbreak  of 
hostilities. 

Aegis  cruisers  will  be  assigned  to  ballistic  missile  defense  duty  off  the 
island's  two  major  ports,  and  SSNs  will  be  assigned  to  attack  enemy 
interdiction  submarines.  Figure  2.2  illustrates  the  disposition  of  a 
portion  of  U.S.  naval  forces  in  the  theater  at  D-day. 


1  “MODLOC”  stands  for  Miscellaneous  Operational  Details,  Local  Operations;  fixed, 
geographically  defined  operating  areas. 
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•  Air  Superiority:  U.S.  forces  will  help  defeat  raids  across  the  wa¬ 
ters  between  the  island  and  the  aggressor  and  kill  leakers  over 
the  island  either  directly  using  its  fighter  aircraft  or  indirectly  by 
providing  command  and  control  support. 

•  Missile  Defense:  Early  on,  the  Aegis  cruisers  will  provide  Theater 
Ballistic  Missile  Defense  (TBMD)  over  critical  ports  and  airfields. 
Later  in  the  conflict,  U.S.  forces  will  attack  surface  combatants 
who  are  equipped  with  Land-Attack  Cruise  Missiles  (LACMs). 
The  aggressor’s  intent  to  use  its  missiles  early  lends  urgency  to 
the  latter  mission. 


•  Breaking  the  Blockade:  Enemy  surface  ships  operating  outside 
ports  and  bastions  can  be  eliminated  quickly.  Nevertheless, 
these  ships  collectively  threaten  U.S.  Navy  forces  in  the  area.  A 
large,  saturation  ASCM  attack  would  be  particularly  attractive  to 
the  aggressor.  It  would  be  difficult  to  coordinate  such  an  attack, 
but  it  could  succeed  through  force  of  numbers.  The  aggressor’s 
interdiction  effort  will  give  its  submarines  freedom  of  operation. 


Figure  2.2— Disposition  of  U.S.  Naval  Force 
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Conditions  around  the  island  are  expected  to  be  poor  for  ASW, 
so  relatively  advanced  threats  like  the  improved  Kilo  will  be  hard 
to  find. 

•  Placing  the  Enemy  on  the  Defensive:  U.S.  presence  in  the  con¬ 
flict  will  force  the  enemy  navy  into  a  defensive  posture.  In  2010, 
the  aggressor  will  have  no  counter  for  U.S.  nuclear-powered 
attack  submarines  (SSNs),  for  example.  At  sea,  the  best 
destroyers  available  to  the  aggressor  will  be  easy  targets  for  a  Los 
Angeles-class  SSN.  Consequently  we  would  expect  that  enemy 
surface  combatants  would  retreat  to  ports  or  bastions,  thus 
preventing  their  certain  destruction  in  open  waters.  The 
aggressor's  surface,  subsurface,  and  air  platforms  will  be  largely 
ineffective  against  modern  U.S.  SSNs.  Consequently,  defense  in 
depth  is  the  enemy’s  only  option.  It  could  interpose  minefields, 
ships  with  active  sonar,  and  submarines  to  try  to  stop  a  U.S.  SSN. 
With  surface  combatants  forced  to  retreat  for  self-protection  and 
with  forces  committed  to  the  defense  of  high-value  units  and 
systems,  fewer  capable  combatants  will  be  available  to  the 
aggressor  for  use  against  the  island. 

THE  BASIS  FOR  ANALYSIS 

Central  to  the  analysis  of  vignettes  derived  from  this  and  other  sce¬ 
narios  is  the  effect  of  changed  command  and  control  systems  and 
procedures  on  the  outcome  of  the  battle.  Network-centric  opera¬ 
tions  purport  to  improve  combat  operations.  However,  this  is  merely 
an  assertion  and  therefore  must  be  regarded  as  a  hypothesis.  How¬ 
ever  plausible  it  may  sound,  it  requires  rigorous  assessment,  and,  to 
do  that,  a  credible  link  between  command  and  control  systems  and 
procedures  and  combat  outcomes  needs  to  be  established. 

In  the  next  two  chapters  we  attempt  to  do  just  that.  We  focus  on  the 
development  of  mathematical  relationships  that  link  network- centric 
operations,  command  and  control,  combat  operations,  and  combat 
outcomes  in  the  context  of  the  scenario  just  described.  In  assessing 
network- centric  operations  and  command  and  control  procedures, 
we  develop  measures  of  performance.  Assessing  combat  operations 
and  combat  outcomes  is  generally  accomplished  through  the  devel¬ 
opment  of  measures  of  combat  effectiveness.  In  this  work  we  have 
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linked  the  two  so  that  the  effects  on  combat  outcomes  of  variations 
in  C4ISR  procedures  and  processes  can  be  assessed. 

In  developing  the  combined  metrics,  we  rely  on  graph  theory  to  as¬ 
sess  the  value  of  connectivity,  information  theory  to  assess  the  value 
of  collaboration  and  the  effects  of  knowledge,  and  traditional  mea¬ 
sures  of  combat  to  assess  the  value  of  combat  power.  It  is  important, 
however,  that  we  emphasize  that  no  claims  are  made  concerning  the 
‘‘correctness"  of  these  formulations.  They  must  be  treated  as  hy¬ 
potheses  subject  to  testing,  validation,  and  calibration. 


Chapter  Three 

CRUISE  MISSILE  AND  BALLISTIC  MISSILE  DEFENSE 


This  chapter  examines  the  information  aspects  of  ship  defense 
against  ASCMs  while  those  ships  conduct  TBMD.  Overall,  the 
defense  problem  is  analyzed  as  a  double -queuing  problem.  First,  the 
launched  ASCMs  and  ballistic  missiles  in  a  given  time  period,  T,  en¬ 
ter  an  initial  engagement  queue  based  on  an  assessment  of  the  like¬ 
lihood  that  cruise  missiles  will  be  a  threat  to  the  defenders  (two  Aegis 
cruisers)  or  that  the  ballistic  missiles  will  be  a  threat  to  critical  infra¬ 
structure  targets.  Second,  if  no  interceptor  missile  defeats  the 
incoming  attack  missiles,  one  of  two  things  will  occur:  ASCM  leakers 
will  join  a  second  queue  to  be  “serviced”  by  the  Close-In  Weapon 
System  (CIWS)  on  board  the  cruisers,  or  ballistic  missile  damage  to 
land  targets  will  be  assessed.  ^ 

We  begin  by  discussing  the  development  of  the  “initial  engagement 
queue”  and  the  rate  at  which  that  queue  is  populated  or  the  arrival 
rate  of  missiles  for  each  time  period.  Next,  we  develop  the  appro¬ 
priate  “service”  rates  depending  on  the  shooting  policy  established. 
Finally,  we  address  the  leaker  or  terminal  queue. 


^http://www.chinfo. navy.mil/navpalib/factfile/weapons/wep-phal.html.  Phalanx 
provides  ships  of  the  U.S.  Navy  with  a  “last-chance”  defense  against  antiship  missiles 
and  littoral  warfare  threats  that  have  penetrated  other  fleet  defenses.  Phalanx  auto¬ 
matically  detects,  tracks,  and  engages  antiair  warfare  threats,  such  as  antiship  missiles 
and  aircraft,  while  the  Block  IB’s  man-in-the-loop  system  counters  the  emerging  lit¬ 
toral  warfare  threat. 
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INITIATING  EVENTS 

Two  Aegis  cruisers  are  assigned  to  cover  the  area  of  operations  as 
depicted  in  Figure  3.1  in  order  to  defend  against  a  likely  enemy  cruise 
and  ballistic  missile  attack.  Given  their  role  in  defending  friendly 
territory,  the  cruisers  are  also  likely  to  be  targets  and  therefore  they 
are  prepared  to  defend  against  such  an  attack. 

Although  it  is  likely  that  other  ships  would  be  in  the  area  of  opera¬ 
tions,  for  purposes  of  this  analysis,  we  assume  that  only  the  two  Aegis 
cruisers  are  involved  in  the  attack  and  in  the  defensive  operations. 


Measures  of  Performance  and  Force  Effectiveness 

The  Aegis  cruisers  have  two  (competing)  missions:  defend  against 
cruise  missile  attacks  against  themselves  and  prevent  enemy  ballistic 
missiles  from  destroying  key  allied  infrastructure  targets.  For  both 
missions,  the  obvious  measure  of  success  is  survivability;  that  is,  the 
fraction  of  the  critical  infrastructure  targets  that  survive  the  attack 
and  the  “fraction**  of  the  cruisers  that  survive  the  attack.  In  the  case  of 
the  cruisers,  the  “fraction  surviving”  may  not  be  meaningful  in  that  a 
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single  hit  by  a  cruise  missile  is  likely  to  result  in  damage  sufficient  to 
render  the  ship  useless. 

Given  the  two  missions,  priority  is  clearly  given  to  defending  the  two 
Aegis  cruisers.  If  they  fail  to  defend  themselves,  they  cannot  conduct 
TBMD.  Depending  on  the  nature  of  the  attack,  this  can  pose  serious 
problems  for  the  defense  of  allied  infrastructure  targets. 

Few  uncertainties  are  considered  in  this  analysis.  We  assume  that 
the  AN/ SPY- 1  radars  on  board  the  cruisers  will  detect  and  track  all 
missiles  the  enemy  is  able  to  launch  with  certainty.^  Only  those 
missiles  considered  likely  to  hit  infrastructure  targets  and  the  cruis¬ 
ers  are  considered  a  threat. 

We  further  assume  that  through  the  Intelligence  Preparation  of  the 
Battlespace  (IPB)  process,  the  size  of  the  enemy  missile  attack  inven¬ 
tory  is  known.  It  is  also  possible  that  the  fixed  launch  sites  would  be 
known  as  a  result  of  the  same  process.  The  locations  of  sea-  or  land- 
based  mobile  launch  sites  are  not  likely  to  be  known.  However,  we 
assume  air  and  sea  supremacy,  and  therefore  these  are  no  longer  a 
serious  threat.  The  minimum  time  required  to  launch  an  attack  can 
also  be  estimated.  What  is  not  known,  however,  is  the  attack  distri¬ 
bution  for  ballistic  missiles  and  cruise  missiles — i.e.,  how  the  enemy 
will  schedule  the  attack  to  ensure  that  the  friendly  infrastructure  tar¬ 
gets  are  destroyed  while  minimizing  interference  from  the  defending 
cruisers. 

Knowing  the  attack  distribution  contributes  directly  to  the  allocation 
of  missile  interceptors  and  therefore  to  the  effective  defense  of  both 
the  cruisers  and  the  friendly  infrastructure  targets.  Defenders  may 
determine  that  they  have  ample  defensive  weapons,  for  example, 
and  therefore  respond  more  aggressively.  A  measure  of  performance 
therefore  is  the  degree  to  which  the  friendly  commander  ‘‘knows’'  the 
enemy’s  attack  distribution.  Before  the  attack  begins  little  is  known, 
and  at  the  end  of  the  attack  the  distribution  is  known  with  certainty. 


^The  heart  of  the  Aegis  system  is  an  advanced,  automatic  detect  and  track,  multifunc¬ 
tion  phased-array  radar,  the  AN/SPY-1.  This  high-powered  (four-megawatt)  radar  is 
able  to  perform  search,  track,  and  missile  guidance  functions  simultaneously  with  a 
track  capacity  of  more  than  100  targets.  The  computer-based  command  and  decision 
element  is  the  core  of  the  Aegis  combat  system. 
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As  the  attack  unfolds  and  the  enemy  completes  its  attack,  more  in¬ 
formation  is  obtained  allowing  the  friendly  commander  to  increase 
his  knowledge  concerning  the  distribution  of  the  remaining  attack. 

ALTERNATIVES 

Network- centric  operations  include  connectivity,  equipment,  and 
operating  procedures  (information  and  sensor  grids).  The  emphasis 
here  is  on  the  operating  procedures — i.e.,  the  degree  of  cooperation 
between  the  two  cruisers  in  servicing  the  targets.  This  in  turn  de¬ 
pends  on  the  nature  of  the  connectivity  between  the  two  and  the 
command  and  control  arrangements  in  place.  In  this  simple  ar¬ 
rangement,  operations  consist  primarily  of  how  the  two  cruisers 
function  to  accomplish  the  desired  mission.  For  this  study,  we  exam¬ 
ine  three  alternatives:  operations  with  divided  duties,  independent 
operations  using  a  shared  COP,  and  coordinated  operations  using 
CEC. 


Cruiser  Operations 

The  Aegis  cruisers  operate  in  pairs  with  one  cruiser,  directing 
its  SPY-1  radar  to  detect  and  track  ballistic  missiles,  while  the  other 
cruiser,  directs  its  SPY-1  radar  to  detect  and  track  ASCMs  as  de- 
Pj^ied  in  Figure  3.2.  This  is  necessary  to  ensure  that  both  threats  are 
covered  given  that  both  types  of  coverage  cannot  be  provided  simul¬ 
taneously  by  a  single  radar. 


Platform-Centric  Operations — Divided  Duties 

In  this  case,  the  two  cruisers  operate  almost  autonomously  (see  Fig¬ 
ure  3.3).  That  is,  no  mechanism  on  board  either  ship  automatically 
shares  information  on  the  arriving  threat  and/or  firing  solutions  and 
no  central  authority  directs  the  defensive  response.  Control  is  de¬ 
centralized  and  managed  in  the  Command  Information  Center  (CIC) 
and  therefore  each  ship  acts  alone:  one  (A^^^)  against  all  incoming 
cruise  missiles  and  the  other  against  all  incoming  ballistic 
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Figure  3.2 — Cruiser  Operations 

n/KmMR1449-3.3 


20  Measures  of  Effectiveness  for  the  Information-Age  Navy 


missiles.3  Both  Aegis  ships  employ  a  first-in-first-out  (FIFO)  queue- 
discipline  policy  for  engaging  incoming  missiles.  For  cruise  missiles, 
this  means  that  self-preservation  is  collective.  That  is,  the  ship  desig¬ 
nated  to  intercept  cruise  missiles  does  not  give  itself  priority  against 
attack. 

Both  ships  must  take  several  decisions  based  on  the  situation  they 
confront  and  the  information  available  to  them  from  organic  and  ex¬ 
ternal  sources.  Not  all  of  these  decisions  are  modeled  in  this  study. 
The  description  of  the  modeled  decisions  appears  later. 

•  The  ballistic  missOe  defense  ship,  must  prioritize  ballistic 
missile  threats.  If  it  concludes  that  an  enemy  missile  is  not  going 
to  hit  a  high-value  target,  it  may  not  defend  against  it.  If  it  con¬ 
cludes  that  an  enemy  missile  will  impact  a  high-value  target,  it 
either  chooses  to  engage  it  or  may  conclude  that  it  will  be  de¬ 
fended  by  another  system,  such  as  Patriot,  and  therefore  choose 
not  to  defend  against  it.  If  it  concludes  that  an  incoming  enemy 
missile  will  impact  a  target  no  longer  worth  defending  (because  it 
was  destroyed  earlier),  it  will  not  defend  against  it.  It  must  de¬ 
cide  how  many  Standard  missiles  it  is  willing  to  assign  against  a 
given  incoming  enemy  ballistic  missile.  If  it  appears  that  it  could 
run  out  of  defensive  weapons  before  the  ballistic  missile  attack 
ends,  it  must  decide  if  that  is  a  real  problem  and  work  to  switch 
roles  with  the  other  cruiser  (covered  separately  below).  Although 
it  has  no  inherent  self-defense  capability,  it  can  decide  how  to 
operate  so  that  the  other  ship  can  defend  it. 

•  The  cruise  missile  defense  ship,  ,  must  prioritize  its  response 
to  cruise  missile  threats.  It  must  decide  between  defending  itself 
and  the  ballistic  missile  defense  ship  based  on  remaining  inven¬ 
tories  of  anti-cruise  missile  (ACM)  and  anti-ballistic  missile 
(ABM)  weapons  on  board  both  ships.  It  must  decide  how  many 
Standard  missiles  it  is  willing  to  assign  to  a  given  cruise  missile  as 
with  the  A^^^  ship.  If  it  appears  that  it  could  run  out  of  defensive 


One  or  two  Aegis  ships  could  perform  simultaneous  cruise  missile  and  ballistic  mis¬ 
sile  defense.  Use  of  two  Aegis  ships  was  selected  for  this  analysis  because  of  the  more 
challenging  command  and  control  problem  associated  with  using  two  ships  and 
because  two-ship  defense  was  judged  more  appropriate  to  the  projected  threat.  This 
arrangement  should  be  viewed  as  a  "first  step”  toward  developing  discrete,  collabora¬ 
tive  command  and  control  metrics  in  a  network-centric  context. 
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weapons  before  the  cruise  missile  attack  ends,  it  must  decide  if  it 
has  a  real  problem  and  work  to  switch  roles  (covered  separately 
below).  It  can  also  attempt  to  maneuver  to  make  it  easier  to  de¬ 
fend  itself  and  the  ballistic  missile  defense  ship. 

•  Role-switching  decision:  The  operational  sequence  for  switch¬ 
ing  roles  is  illustrated  in  Figure  3.4.  Once  it  has  been  determined 
that  a  reversal  in  roles  is  necessary  (based  on  inventory  levels  of 
ACMs  and  ABMs  on  both  ships),  the  ballistic  missile  defense  ship 
“lowers”  the  regard  of  its  SPY-1  radar  to  search  for  cruise  missiles 
(Figure  3.3a).  During  this  period,  there  is  no  ballistic  missile 


Figure  3.4 — Role- Switching  Operations 


22  Measures  of  Effectiveness  for  the  Information-Age  Navy 


defense  capability,  meaning  ballistic  missile  tracks  built  up  may 
be  lost.  Once  both  ships  have  cruise  missile  tracks  (i.e.,  once 
has  cruise  missile  tracks),  can  raise  the  regard  of  its 
SPY-1  rato  to  detect  ballistic  missiles.  Role  reversal  is  complete 
when  A^^^  has  built  up  ballistic  missile  tracks  and  can  begin 
defending  against  them. 

Except  for  a  brief  turnover  period,  divided  duties  operations  means 
that  only  one  ship  can  defend  against  cruise  missiles  at  any  time. 
Cruise  missile  saturation  is  relatively  easy  because  only  one  ship’s 
launchers  are  used  to  protect  two  ships.  Cruise  missiles  that  could 
be  stopped  by  two  ships  become  “too  hard”  for  a  single  ship  with  a 
single  geometry.  The  ballistic  missile  ship  is  unable  to  periodically 
step  in  to  help  the  cruise  missile  ship.  Similarly,  ballistic  missile  sat¬ 
uration  is  difficult  to  prevent.  To  avoid  running  out  a  magazine  the 
ships  may  have  to  swap  roles,  leaving  a  gap  in  ballistic  missile  de¬ 
fenses.  After  a  switch,  knowledge  of  which  targets  have  been  hit  may 
disappear. 


Network-Centric  Operations— Shared  COP 

In  the  shared  COP  mode,  both  ships  can  see  and  defend  against  both 
incoming  ballistic  missiles  and  incoming  cruise  missiles  (see  Figure 
3.5).  We  term  this  case  network-centric  because  an  understanding 
exists  between  the  two  ships  concerning  the  nature  of  the  attack. 
This  implies  greater  connectivity  than  in  the  platform-centric  case. 
Information  on  missile  threat  trajectories  and  arrival  times  is  shared 
electronically,  and  in  this  sense  the  two  ships  can  collaborate.  As  in 
the  previous  case,  one  ship  ( A^^^)  trains  its  SPY-1  radar  to  detect  bal¬ 
listic  missiles  and  the  other  (A^^^)  to  detect  cruise  missiles.  Even 
though  sensor  information  is  shared,  the  two  ships  continue  to 
operate  independently:  no  cooperation  or  coordination  takes  place 
between  the  ships.  However,  both  ships  have  cruise  missile  and  bal¬ 
listic  missile  defense  responsibilities.  As  a  result,  poor  “queue  dis¬ 
cipline”  is  likely  in  that  both  ships  may  engage  the  same  missile  or 
fail  to  engage  a  missile  that  with  better  coordination  might  have  been 
engaged. 

The  decisions  in  this  case  center  on  how  to  ensure  the  optimal  allo¬ 
cation  of  defensive  weapons  against  both  cruise  and  ballistic  missiles 
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Figure  3.5 — Shared  COP  Connectivity 


given  decentralized  control.^  The  problem  is  complicated  by  the  fact 
that  either  ship  can  defend  against  either  type  of  threat.  These  deci¬ 
sions  are  described  in  more  detail  later.  The  decisions  for  both  ships 
are: 

•  Self-Protection:  The  primary  goal  of  both  ships  is  survival. 
However,  undue  emphasis  on  self-protection  means  the  other 
ship  can  be  hit  (possibly  leaving  the  remaining  ship  more  vulner¬ 
able).  In  addition,  undue  emphasis  on  protecting  the  two  ships 
degrades  defense  against  ballistic  missiles.  Each  ship  decides 
which  of  the  incoming  enemy  missiles  are  easier  for  it  to  hit 
based  on  location  and  trajectory  of  the  missile  in  relation  to  its 
ovm  position.  This  sets  up  an  attack  priority.  This  can,  of  course, 
result  in  two  ships  attacking  the  same  cruise  missile  target. 

•  Ballistic  Missile  Interception:  Although  the  primary  goal  of  the 
two  cruisers  is  self-protection,  their  operational  mission  is  to 
protect  critical  friendly  infrastructure.  In  the  absence  of  a  cruise 


^The  term  "optimal”  is  used  here  and  throughout  the  text  in  the  sense  that  major  im¬ 
provements  can  be  realized. 
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missile  threat,  the  same  rules  applied  to  cruise  missile  defense 
are  applied  to  ballistic  missile  defense  with  the  same  possibility 
that  both  ships  attack  the  same  incoming  enemy  missile. 

We  would  expect  that,  under  these  conditions,  cruise  missile  and 
ballistic  missile  saturation  would  require  about  twice  the  arrival  rate 
of  the  previous  case.  This  is  based  on  both  ships’  ability  to  engage 
cruise  missiles  as  well  as  ballistic  missiles.  Given  a  target  difficult  for 
one  ship  and  relatively  easy  for  the  other,  there  is  a  natural  tendency 
for  the  shot  to  be  ’'assigned”  appropriately.  Systematically  reducing 
incoming  missiles  is  not  possible  because  the  ships  are  unable  to 
cooperate  in  any  organized  way.  Without  cooperation,  if  one  ship 
gets  into  trouble,  the  other  generally  cannot  step  in  quickly  to  help. 
Situational  awareness  is  increased  in  this  case,  but  the  Guided  Mis¬ 
sile  Cruisers  (CGs)  cannot  affect  all  events  they  can  see. 

Network- Centric  Operations — Cooperative  Engagement 

As  in  the  previous  two  cases,  one  ship  has  its  SPY-1  trained  on  in¬ 
coming  cruise  missiles  and  the  other  on  incoming  ballistic  missiles 
(see  Figure  3.6).  Now,  however,  both  ships  have  access  to  complete 
defense  solutions  and  the  allocation  of  ships  to  targets  is  controlled 
centrally — by  one  of  the  two  ships  engaged  in  the  operation.  We  de¬ 
pict  a  separate  node  for  this  additional  function  for  the  controlling 
commander.  Not  only  connectivity  is  required  in  this  case,  but  also 
automated  systems  to  assess  the  relevant  factors  that  go  into  making 
the  best  decision.  Both  ships  have  cruise  missile  and  ballistic  missile 
defense  responsibilities  as  in  the  previous  case. 

The  decisions  in  this  case  center  on  how  to  ensure  the  optimal  allo¬ 
cation  of  defensive  weapons  against  both  cruise  and  ballistic  missiles 
given  centralized  control  and  a  richer  shared  COP.  As  in  the  previous 
cases,  the  descriptions  of  how  the  decisions  listed  here  are  imple¬ 
mented  in  the  model  follow  later.  The  decisions  for  both  ships  are: 

•  Cruise  Missile  Defense:  Single-authority  decisions  to  engage  in¬ 
coming  cruise  missiles  are  made  on  the  basis  of  which  ship  is 
closer  to  being  overwhelmed.  That  is,  if  saturation  of  ship  de¬ 
fenses  is  imminent,  defensive  efforts  will  shift  from  TBMD  to 
ASCM  defense.  In  this  case,  if  one  ship  faces  an  imminent  threat, 
defensive  efforts  will  focus  to  defend  it.  Overall,  priority  is  given 
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Figure  3.6 — Cooperative  Engagement  Connectivity 


to  engaging  cruise  missiles,  but  now,  the  two  ships  cooperate  to 
ensure  that  the  most  threatened  ship  is  protected  first.  It  may  be 
necessary  to  prioritize  protection  of  one  ship  over  the  other.  A 
hit  to  the  ship  with  the  radar  set  for  cruise  missiles  will  leave  the 
other  ship  completely  unprotected  for  a  short  period,  so  it  may 
be  given  higher  priority. 

•  Ballistic  Missile  Defense:  The  single  authority  must  prioritize 
the  goals  of  self-protection,  protecting  the  other  ship,  and  pro¬ 
tecting  against  ballistic  missiles.  Undue  emphasis  on  ship  pro¬ 
tection  can  degrade  performance  against  ballistic  missiles.  The 
optimal  allocation  of  interceptors  to  incoming  enemy  ballistic 
missiles  depends,  in  part,  on  the  knowledge  the  central  authority 
has  concerning  the  distribution  and  projected  size  of  the  attack. 

Both  ships  can  defend  against  cruise  missiles  and  against  ballistic 
missiles,  and  they  can  cooperate  and  coordinate.  Cruise  missile  sat¬ 
uration  requires  at  least  twice  the  arrival  rate  of  the  baseline  case. 
Given  a  simultaneous  need  to  engage  an  easy  target  and  a  hard  one, 
an  optimal  decision  may  be  made  based  on  the  relative  position  of 
the  ships.  Systematically  reducing  incoming  missiles  is  now  possible 
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because  of  mutual  cooperation.  Similarly,  ballistic  missile  saturation 
is  at  least  twice  as  difficult  for  the  reasons  stated  in  the  previous  case. 
With  cooperation,  if  one  ship  gets  into  trouble,  the  other  can  step  in 
to  help. 

THE  INITIAL  ATTACK  QUEUE 

In  any  period,  not  all  attacking  cruise  and  ballistic  missiles  will  be 
judged  to  be  threats.  Ballistic  missiles  not  projected  to  damage  pre¬ 
designated  critical  infrastructure  targets  are  not  considered  to  be  a 
threat— even  though  they  may  land  on  friendly  soil.  For  this  study, 
these  targets  are  taken  to  be  the  airports  of  debarkation  and  seaports 
of  debarkation.  Cruise  missiles  not  projected  to  damage  the  two 
Aegis  cruisers  are  not  considered  to  be  threatening.  The  initial  attack 
queue  consists  only  of  those  missiles  projected  to  hit  critical 
infrastructure  targets  or  the  two  Aegis  cruisers.^  The  rate  at  which 
that  queue  is  populated  (the  arrival  rate)  is  therefore  of  interest  and 
not  the  rate  at  which  the  missiles  are  detected  by  the  Aegis  radars. 

For  simplicity,  we  assume  that  only  ballistic  missiles  are  directed  to¬ 
ward  infrastructure  targets  and  only  cruise  missiles  are  directed  to¬ 
ward  the  Aegis  cruisers.  We  further  assume  that  Aegis  cruisers  are 
the  only  targets  for  the  enemy  cruise  missiles.  Other  ships  in  the 
theater  are  not  considered  to  be  “in  play.”^ 

ARRIVAL  RATES 

Analysis  of  the  value  of  network- centric  operations  begins  with  the 
average  rate  at  which  missiles  arrive  at  the  initial  attack  queue.  This 
is  taken  to  be  an  input.  The  ability  of  the  enemy  to  effectively  target 
friendly  infrastructure  with  ballistic  missiles  and  its  ability  to  attack 
friendly  ships,  although  important  to  the  arrival  rate  as  defined  here, 
are  not  considered  in  this  analysis.  We  assume  a  level  of  enemy  ca¬ 
pability  and  focus  our  attention  on  the  queue  itself.  In  a  more  de- 


^This  is  based  on  the  assumption  that  track  and  projection  capability  is  sufficient  to 
discriminate  between  threat  and  nonthreat  missiles. 

^These  constraints  can  easily  be  relaxed.  They  are  imposed  here  to  allow  for  concen¬ 
tration  on  the  problem  of  defending  against  the  dual  threat  where  the  focus  is  on  al¬ 
ternative  command  and  control  processes. 
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tailed  simulation,  the  capability  of  the  enemy  to  target  friendly  assets 
may  be  of  interest.  What  is  important  here,  however,  is  the  ability  of 
the  defending  Aegis  cruisers  to  deal  with  a  given  threat. 

The  Attack  Scenario 

First,  we  assume  that  for  the  entire  attack,  the  number  of  launched 
cruise  missiles  arriving  is  and  the  number  of  ballistic  missiles  ar¬ 
riving  is  nij.  The  duration  of  the  attack  is  taken  to  be  T  minutes. 
During  that  interval,  the  arrival  rate  will  vary.  We  assume  that  the 
missiles  arrive  in  x  intervals  each  of  which  is  t  minutes  in  duration  so 
that  T=xt.  We  further  define  the  average  arrival  rates  per  minute  in 
time  period  i  for  the  two  types  of  missiles  to  be  and  Xi^f .  The  to¬ 
tal  number  of  cruise  missiles  and  ballistic  missiles  arriving  in  the  at¬ 
tack  [ric  and  riij)  and  the  number  of  each  type  arriving  in  each  time 
period  are  set  parametrically.  Therefore,  the  total  number  of  each 
type  of  missile  arriving  in  time  period  i  is  X^  t  and  Xiji  f,  and  we  have 
that  the  total  attack  sizes  for  the  duration  of  the  attack,  T,  are 

tic  ~  ~  ’ 

Note  that  the  average  arrival  rates  in  each  time  period  are  derived 
from  the  parametrically  set  number  of  missiles  arriving  in  the  period. 
Figure  3.7  illustrates  a  distribution  of  300  cruise  missiles  and  50  bal¬ 
listic  missiles  over  t  =  5  time  periods.  The  shape  of  the  distribution 
will  depend  on  the  enemy's  attack  strategy.  If  the  objective  is  to  satu¬ 
rate  the  allied  defenses  early,  then  the  enemy  might  opt  to  coordi¬ 
nate  the  launch  of  a  large  part  of  its  inventory  to  generate  a  large 
number  of  arrivals  in  the  early  periods.  On  the  other  hand,  if  the 
enemy’s  objective  is  to  keep  the  cruisers  busy  while  it  pursues  other 
offensive  strategies,  then  a  more  uniform  arrival  rate  is  more  likely.  ^ 


^Clearly,  an  “optimal”  strategy  would  be  to  fire  all  missiles  so  that  they  arrive  simulta¬ 
neously  and  thereby  saturate  the  friendly  defenses.  However,  this  is  nearly  impossible 
to  accomplish. 
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Figure  3.7— Enemy  Missile  Arrival  Distribution 


Additional  Granularity 

An  important  feature  of  the  initial  attack  queue:  it  is  “perishable." 
That  is,  service  consists  of  destroying  the  missile  in  the  queue  or,  in 
case  of  possibly  repeated  misses,  absorbing  its  impact.  A  successful 
outcome,  of  course,  is  destruction  of  the  missile,  and  therefore  the 
sequence  of  arrivals  is  equally  important.  Because  of  this,  we  further 
subdivide  each  time  period  into  subintervals  with  arrivals  in  each 
subinterval  distributed  according  to  a  right-truncated  Poisson.  The 
right-truncated  Poisson  has  a  probability  mass  function  of  the  form: 

p[m:X]  =  <D - — ,  for  m  =  0,1, ... ,  g, 

ml  ® 
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where  m  is  the  number  of  missiles  arriving  in  the  subinterval,  g= 
or  g  -  Xi,t  is  the  number  of  cruise  missiles  or  ballistic  missiles  arriv¬ 
ing  in  the  time  period,  and 


<D  = 


1 


oo 

h=g+l 


h\ 


Note  that  as  g^«^,  0^1.  Therefore, 

lim  p[m:X]  = - = 

g  m! 

This  is  the  standard  Poisson  distribution  with  mean  equal  to  X  = 
or  X  =  Xij  for  the  given  time  period. 

If  the  number  of  subintervals  is  5,  then  we  can  calculate  the  average 
number  of  missiles  arriving  in  each  subinterval  of  duration:  d  =  t/s. 

For  example,  suppose  the  average  arrival  rate  for  cruise  missiles  in  a 
single  time  period  is  =  3  missiles  per  minute.  If  a  time  period  is  5 
minutes  in  duration,  we  can  expect  g  =  15  missiles  to  arrive  in  that 
time.  If  we  further  assume  that  the  period  is  subdivided  into  5  =  5 
subintervals,  the  average  number  of  missiles  that  arrive  in  each  of  the 
5  subintervals  (each  of  which  is  =  5/5  =  1  minute  in  duration)  is  h  = 
g/s  =  3.  What  remains  is  to  calculate  the  fraction  of  the  15  missiles 
that  arrive  in  each  of  the  5  subintervals. 

One  way  to  distribute  the  arrivals  is  to  use  the  cumulative  probability 
distribution: 


p{m  <m:X)  =  ^^_^pim:X) . 

If  there  are  s  subintervals  in  a  time  period,  with  g  arrivals,  then  the 
number  of  arrivals  in  each  subinterval,  h,  is  calculated  to  be  as  fol¬ 
lows: 
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Figure  3.8  illustrates  the  further  distribution  of  the  missiles  in  Figure 
3.7  using  this  methodology. 

The  subdivision  of  each  interval  allows  us  to  model  staggered  arrivals 
throughout  the  period.  This  means  that  missiles  will  appear  as  tar¬ 
gets  for  the  Aegis  interceptors  at  intervals.  If  we  assume  that  within 
each  time  subdivision,  incoming  cruise  missiles  are  detected  at  the 
same  time,  then  the  number  of  opportunities  for  the  Aegis  cruiser  to 
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NOTE:  In  this  example  x  =  5,  t  =  5  minutes,  and  therefore  r=  25  minutes.  For  both 
cruise  missiles  and  ballistic  missiles,  s  =  3.  For  time  period  3,  for  example,  g  =  6 

x5  =  30  cruise  missiles  (approximately  60  percent  of  cruise  missile  inventory).  The 
distribution  to  the  subintervals  is  then  hi  =20,  h2  =  6,  and  113  =  4. 

Figure  3.8— Subinterval  Enemy  Missile  Arrival  Distribution 


Cruise  Missile  and  Ballistic  MissOe  Defense  31 


engage  the  missiles  will  depend  on  the  time  required  to  shoot  a  sin¬ 
gle  missile  and  the  shooting  policy  adopted  by  the  cruiser. ^ 

Allocation  to  Targets 

Next,  we  address  the  distribution  of  arriving  missiles  to  friendly  tar¬ 
gets.  For  simplicity,  we  assume  that  the  distribution  of  missiles  to 
targets  is  constant  throughout  all  periods  and  subintervals.  For 
cruise  missiles,  the  arriving  missiles  are  allocated  to  the  two  de¬ 
fending  Aegis  cruisers,  and  If  the  proportion  of  incoming 
cruise  missiles  that  will  attack  is  0  <  a  <  1,  then  the  total  number 
of  incoming  cruise  missiles  that  will  attack  each  cruiser  is  an^  to  A^^^ 
and  (1  -  a)  to  A^^K^ 

The  arriving  ballistic  missiles  are  allocated  to  infrastructure  targets 
much  in  the  same  way,  the  difference  being  that  there  may  be  more 
infrastructure  targets  to  be  defended.  In  this  case,  we  let  co^-  be  the 
fraction  of  incoming  ballistic  missiles,  targeted  against  infra¬ 
structure  target  i ,  where 


and  ri  is  the  total  number  of  infrastructure  targets  at  risk.  Again,  we 
assume  that  the  distribution  of  ballistic  missiles  to  infrastructure  tar¬ 
gets  is  constant  throughout  all  attack  periods. 

SHOOTING  POLICY 

The  “shooting”  policy  affects  the  degree  to  which  the  weapon  inven¬ 
tory  on  board  the  cruisers  is  depleted.  In  this  work,  we  postulate 
three  policies:  shoot  only,  shoot-look-shoot,  and  shoot-look-salvo  2. 
We  explain  each  of  these  next,  but  reserve  explanation  of  their  impli¬ 
cations  on  success  to  later. 


^This  is  discussed  later. 

®We  avoid  the  term  “allocated”  because  such  fine  precision  given  the  operational 
proximity  of  the  two  ships  is  not  possible.  This  therefore  is  a  modeling  artifact. 
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•  Shoot  Only:  This  is  the  simplest  policy.  As  threat  missiles  pre¬ 
sent  themselves,  one  or  both  of  the  ships  launch  a  counter  mis¬ 
sile.  In  case  of  a  miss,  the  target  missile  is  considered  a  leaker. 
No  further  attempt  is  made  to  engage  it  with  counter  missiles. 

•  Shoot-Look-Shoot:  In  this  case,  one  or  both  of  the  cruisers  will 
fire  against  a  target  missile.  Next,  the  radar  tracking  the  missile 
will  determine  if  the  engagement  was  a  success.  If  not,  a  second 
shot  will  be  fired.  If  the  second  shot  misses,  the  target  missile  is 
again  considered  a  leaker  and  no  further  attempt  is  made  to  en¬ 
gage  it  with  counter  missiles. 

•  Shoot-Look-Salvo  2:  This  last  case  begins  as  in  shoot-look- 
shoot,  but  instead  of  firing  just  one  counter  missile  after  a  miss, 
two  are  salvoed.  If  the  salvo  misses,  the  target  missile  is  again 
considered  a  leaker  and  no  further  attempt  is  made  to  engage  it 
with  counter  missiles. 

Because  there  may  be  insufficient  time  to  fire  the  "postlook”  shots  in 
the  shoot-look-shoot  and  shoot-look-saivo  2  modes,  we  may  also 
explore  intermediate  cases.  If  y  is  the  fraction  of  times  that  post¬ 
look  shots  are  fired  given  that  the  "look”  has  been  executed  and  it  is 
determined  that  the  first  shot  failed  to  intercept  the  incoming  mis¬ 
sile,  then  the  total  number  of  shots  taken  is  (1  -  y)  +  jS,  where  5  =  2 
for  the  shoot-look-shoot  policy  and  3  for  shoot-look-salvo  2  policy. 

SERVICE 

For  one  cruiser,  the  mean  rate  at  which  attack  missiles  can  be  ser¬ 
viced  (the  firing  rate)  is  p  missiles  per  minute. Service,  in  this  case, 
has  several  components.  Three  prominent  ones  are  missile/ 
launcher  test,  missile  preparation,  and  flight  to  target.  Each  consists 
of  a  time  delay  based  on  other  factors.  The  first  two  depend  largely 
on  the  level  of  automation  in  testing,  time  required  to  load  target 
data  into  the  missile,  and  time  to  "warm  up”  subsystems.  Flight  to 
target  depends  on  the  speed  of  intercept  and  the  speed  of  attacking 
missile. 


*^For  simplicity,  we  assume  the  cruisers  service  targets  at  the  same  rate— on  average. 
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The  procedural  factors  affecting  the  service  rate  reflect  the  quality  of 
command  and  control  in  place,  and  therefore  modifications  should 
be  made  parametrically  to  assess  the  impact  on  the  success  of  the 
operation.  Delays  stemming  from  weapon  systems  operating  meth¬ 
ods  are  considered  fixed  for  this  analysis.  However,  insights  might 
be  gained  concerning  possible  weapon  systems  improvements. 

If  we  let  Xy  be  the  mean  time  to  prepare  a  launcher,  T2  the  mean 
time  required  to  launch  the  intercept,  and  T3  the  mean  time  to  fly 
out  to  the  target,  then  the  total  mean  service  rate  for  each  cruiser  is: 

1 

|Ll  = - . 

Ti+T2  +  't3 


Service  is  complete  when  the  incoming  attack  missile  and  the  de¬ 
fending  missile  “meet.”^^ 

SURVIVABILITY 

The  survivability  of  the  defending  Aegis  cruisers  depends  on  their 
ability  to  engage  incoming  cruise  missiles,  their  firing  rate,  and  the 
ability  of  the  terminal  defenses  (CIWS)  to  destroy  terminal  leakers. 
The  firing  rate  can  be  thought  of  as  the  “service  rate.”  When  the  ar¬ 
rival  rate  exceeds  the  service  rate,  then  the  system  becomes 
“saturated.”  Whether  because  of  intercept  failure  or  saturation, 
cruise  missiles  not  destroyed  become  “leakers.”  In  both  cases,  the 
leakers  join  a  second  queue  to  be  serviced  by  the  CIWS.  The  impli¬ 
cations  of  this  are  discussed  below. 

Leakers 

We  let  Pc  be  the  constant  single-shot  probability  that  an  intercept 
from  the  Aegis  cruiser  kills  an  incoming  cruise  missile.  This  ignores 
the  variations  in  threat  weapons  (such  as  stealthy  missiles).  We  use 


the  battle  proceeds,  the  relative  length  of  these  times  will  vary.  Initially,  all  targets 
will  be  engaged  at  maximum  range,  and  therefore  fly-outs  will  be  lengthy.  However, 
later  in  the  fight  we  expect  that  the  fly-out  time  would  be  significantly  reduced 
because  targets  would  be  engaged  closer  in.  In  any  case,  wiU  likely  always  be  larger 
than  Xi  and  X2  • 
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this  kill  probability  only  when  the  threat  missile  is  between  the 
maximum  and  minimum  engagement  range  as  discussed  below.  As 
a  result,  is  independent  for  multiple  defensive  shots,  and  the  ef¬ 
fective  kill  probability  will  depend  upon  the  shooting  mode  and 
For  example,  if  =  0.7,  the  shooting  mode  is  “shoot-look-shoot,” 
and  only  one  ship  engages  the  incoming  missile,  then  the  effective 
probability  that  a  friendly  interceptor  will  kill  an  enemy  cruise  mis¬ 
sile  is  Pk  =  '^Pc-Pc  -  and,  therefore,  the  probability  that  the 
attacking  missile  survives  (becomes  a  “leaker”)  is  Pi  =  0.09. ^  2 
In  addition,  the  expected  number  of  intercept  missiles  required 
to  achieve  this  probability  is  =  2  -  =  2  -  0.7  =  1.3  missiles.^a 

Table  3.1  summarizes  the  effective  kill  probabilities  and  the  expected 
number  of  missiles  fired  for  each  shooting  mode. 

Table  3.1 

Effective  Kill  Probabilities 


Mode 

First-Shot  Kill 
Probability 

Second-Shot  Kill 
Probability 

Pk 

Expected  Shots 
Fired  (Ef) 

One  Ship  Engaged 

Shoot 

Pc 

NA 

Pc 

1 

Shoot-look- 

shoot 

Pc 

Pc)  Pc 

l-(l-Pc) 

1 

CM 

Shoot-look- 
salvo  2 

Pc 

(1-  Pc)Il-(l-  p2)l 

1-(1-Pc)3 

3  2  Pc 

Two  Ships  Engaged 

Shoot 

Shoot-look- 

shoot 

NA 

(l-Pc)2|l-(l-p^)2] 

i-n-Pc)2 

1-(1-Pc)‘' 

2 

4-4pj,  -H2p2 

Shoot-look- 
salvo  2 

i-a-Pc)2 

(1-Pc)2(l-(1-Pc)''l 

1 

1 

s 

6-8pc  +4p2 

The  probability  of  kill  on  the  first  shot  is  and  the  probability  that  the  target  is 
killed  on  the  second  shot  (i.e.,  the  first  shot  misses  and  the  second  hits)  is  (1  -  p.)  Pc  • 
The  effective  probability  then  is  p^)p^  =  2p^  -  p^ . 

^^Three  possible  events  exist:  (1)  the  incoming  missile  is  destroyed  on  the  first  shot 
with  the  expectation  of  1  x  p^  missiles  fired,  (2)  the  first  shot  misses  and  the  second 
intercepts  the  missile  with  the  expectation  of  2(1  -  Pc)  Pc  missiles  fired,  and  (3)  both 
shots  miss  with  the  expectation  of  2{1  -  missiles  fired.  The  sum  of  these  is  Er  = 
2- Pc-  This  methodology  is  used  to  calculate  the  other  expected  values  in  Table  3.1.^ 
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In  general  then,  the  expected  number  of  leakers  in  any  period  i  is 
k  =PLKit>  '^tiere  Pl=1-Pk.  This  is  the  number  that  enters  the 
terminal  queue  in  the  period.  The  distribution  allocated  to  each 
cruiser  is  determined  by  the  apportionment  factor,  a.  This  is  dis¬ 
cussed  more  fully  below. 

Saturation 

Typically,  in  queuing  models,  saturation  occurs  whenever  the  arrival 
rate  exceeds  the  service  rate.  In  this  application,  saturation  would 
occur  whenever  the  rate  at  which  enemy  missiles  arrive  exceeds  the 
rate  at  which  the  Aegis  cruisers  are  able  to  defend  against  them.  Al¬ 
though  this  is  true  in  a  sense,  the  problem  is  a  bit  more  complicated 
because  this  is  not  a  steady- state  problem. 

Enemy  missiles  are  only  vulnerable  to  friendly  intercept  with  Stan¬ 
dard  missiles  during  a  narrow  window  of  opportunity  as  depicted  by 
the  shaded  ring  in  Figure  3.9.  If  this  opportunity  is  missed,  the  sec¬ 
ond  line  of  defense  is  the  CIWS  depicted  by  the  inner  circle.  The 
time- elevation  graph  in  Figure  3.9  illustrates  a  notional  flight  with 
the  times  depicted  as  dotted  lines.  The  times  are: 

•  Tq:  Time  of  enemy  launch. 

•  ti’.  Time  enemy  missile  detected. 

•  t2‘  Earliest  time  missile  can  be  engaged  with  Standard  missile. 

•  :  Latest  time  missile  can  be  engaged  with  Standard  missile. 

•  t^:  Earliest  time  missile  can  be  engaged  by  CIWS. 

•  ^5 :  Impact  time. 

We  assume  that  a  Standard  missile  is  launched  when  a  single  enemy 
missile  heading  toward  the  defending  ship  is  detected — i.e.,  service 
begins  at  ti .  This  means  that  the  friendly  force  has  a  maximum  of 
^3  -  t2  minutes  to  engage  the  enemy  missile.  In  general,  the  follow¬ 
ing  condition  must  hold  for  a  successful  intercept: 
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Figure  3.9 — Cruise  Missile  Engagement  Zones 


where  is  the  service  rate  as  described  above.  For  practical  pur¬ 
poses,  we  can  assume  that  +  1/  p  >  t2—Le.,  it  is  unlikely  that  an 
intercept's  launch  time  will  be  set  such  that  it  will  intercept  the  en¬ 
emy  missile  outside  its  effective  range.  Consequently,  if  h  enemy 
missiles  are  detected  at  time  (average  arrival  rate  in  a  subinter¬ 
val),  we  must  have  that: 


h<  +l/p) 

5 

where  5  is  the  time  required  to  prepare  the  launcher  for  a  subse¬ 
quent  launch:  6  =  Tj  Hence,  when  the  arrivals,  h,  exceed  the 

service  rate  or  when 


might  be  argued  that  these  times  are  insignificant  when  compared  to  the  fly-out 
time  and  therefore  in  low-resolution  models  they  may  be  neglected.  We  retain  them 
here  for  completeness. 
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we  have 


5 

enemy  missiles  that  cannot  be  serviced  in  the  subinterval. 

Because  the  enemy  attack  occurs  over  several  of  the  subintervals,  the 
average  number  of  missiles  the  friendly  commander  must  service  is 
the  average  arrival  rate  for  the  subinterval  plus  the  average  not  ser¬ 
viced  in  the  previous  subinterval.  Furthermore,  because  the  attack 
queue  is  FIFO  (old  targets  must  be  serviced  first),  the  additional  en¬ 
emy  missiles  left  to  be  processed  in  the  next  time  interval  shrink  its 
length.  The  implication  of  this  is  taken  up  next. 

Recall  that  each  subinterval  is  d  =  t/s  minutes  long;  therefore,  the 
number  of  missiles  that  can  be  serviced  in  any  subinterval  is  rf/  6. 
This  is  based  on  the  assumption  that  the  second  and  subsequent 
missiles  can  be  launched  before  the  previous  missile  arrives  on  tar¬ 
get.  In  other  words,  we  need  not  consider  fly-out  times.  Intercepts 
are  launched  at  intervals  of  6  minutes. 

The  reduction  in  the  length  of  the  current  interval  occasioned  by  un¬ 
serviced  missiles  is  summarized  in  Table  3.2.  Both  the  case  where 
unserviced  missiles  are  present  and  where  they  are  not  present  have 
implications  for  the  number  of  missiles  “carried  over”  to  the  next 
subinterval. 

In  the  table,  the  quantity: 


5 


l^Note  that  we  do  not  refer  to  these  as  “leakers.”  The  term  “leaker"  refers  to  any  en¬ 
emy  missile  not  intercepted— including  misses. 
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Table  3.2 

Missiles  Carried  Over 


Missiles  “Carried 
Over” 

Case  I:  No  unserviced 

All  missiles  serviced  in 

missiles 

subinterval: 

None 

-(^1  +l/fi) 

n;  S  — — - - 

'  8 

'’■"I 

Some  missiles  not  serviced  in 

subinterval: 

"'^5 

'“'-f 

Case  II:  unserviced 

All  missiles  that  can  be  serviced 

missiles  present 

will  be  serviced  in  the  subinterval: 

None 

5 

6  "5 

Some  “serviceable"  missiles  are 
not  serviced  in  the  subinterval: 

d 

6  ^6 

f3  ~iti+l/\i)-d 

5 

is  the  number  of  enemy  missiles  that  will  be  serviced  in  the  subinter¬ 
val. 


In  addition  to  varying  the  probability  that  an  incoming  enemy  mis¬ 
sile  will  be  destroyed,  the  shooting  policy  also  affects  the  number  of 
enemy  missiles  that  can  be  engaged  in  a  subinterval.  The  quantities 
depicted  in  Table  3.2  reflect  a  shoot-only  policy.  For  the  shoot-look- 
shoot  and  the  shoot-look-salvo  2  policies,  the  time  required  to  pre¬ 
pare  launchers  for  subsequent  attacks  increases  to  2^  and  36, 
respectively.  The  “look"  portion  of  the  process  is  considered  to  be 
instantaneous  in  that  the  incoming  missile  is  being  tracked  in  real 
time  and  therefore  a  miss  will  be  noted  immediately.  In  the  shoot- 
look-shoot  case,  a  second  intercept  will  be  fired  and  therefore  two 
launch  preparations  are  required  for  each  missile  attacked.  For  the 
shoot-look-salvo  2  case,  three  missiles  are  fired. 

Although  saturation  can  occur  as  a  result  of  the  ballistic  missile  at¬ 
tack  against  infrastructure  targets,  the  real  concern  is  saturation  from 
the  cruise  missile  attack.  We  assume  that  survivability  of  the  Aegis 
cruisers  takes  precedence  over  survivability  of  the  infrastructure 
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targets— not  because  the  infrastructure  targets  are  less  important, 
but  rather  because  with  the  loss  of  the  cruisers  no  further  defense  is 
possible. 

THE  TERMINAL  DEFENSE  QUEUE 

As  mentioned  earlier,  all  cruise  missile  that  are  not  successfully 
engaged  using  Standard  missiles  (as  a  result  of  misses  or  defense 
saturation)  join  the  terminal  defense  queue  to  be  serviced  by  the 
CIWS.i®  The  cruise  missile  arrival  rate  during  any  time  period  for  the 
terminal  queue  is  equal  to  the  average  number  of  leakers  in  that 
period.  As  mentioned  earlier,  the  number  of  leakers  in  a  period,  L/ , 
depends  on  the  shooting  policy,  the  engagement  procedures  (one  or 
two  ships  firing  independently),  and  the  degree  of  network- 
centricity.  The  proportion  of  terminal  leakers  allocated  to  each  of 
the  Aegis  cruisers  is  al;  for  cruiser  and  (1  -  a)L/  for  cruiser 

We  now  let  be  the  single-shot  probability  that  an  enemy  cruise 
missile  will  damage  an  Aegis  cruiser  and  we  let  be  the  average 
level  of  damage  required  to  disable  the  cruiser.  By  ‘'damage”  to  the 
cruiser,  we  mean  that  its  ability  to  engage  attacking  missiles  is 
impaired  by  the  fraction  p^  and  by  “disable,”  we  mean  that  its  abil¬ 
ity  to  engage  cruise  missiles  has  been  lost.  When  the  accumulated 
damage  exceeds  p^,  we  assume  the  ship  can  no  longer  engage 
attacking  missiles.  We  let  Ni  represent  the  number  of  leakers 
required  to  disable  an  Aegis  cruiser.  The  expected  fraction  of  dam¬ 
age  caused  by  the  Ni  attacking  missiles  follows  a  binomial  distribu¬ 
tion  so  that  if  Pa  then  the  expected  number  of  leakers 

required  to  disable  an  Aegis  cruiser  is: 

_  In(l-p^) 

^  In(l-Pd)’ 


assume  that  there  is  no  terminal  defense  queue  for  ballistic  missiles  aimed  at 
infrastructure  tcirgets. 

l^From  SABER/SELECT  (SABSEL)  and  Weapons  Effects  Data  Base  (WEDB)  User’s  Man¬ 
ual,  U.S.  Air  Force. 
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If  we  let  be  the  probability  that  an  incoming  missile  escapes  the 
CIWS,  then  the  combined  probability  of  a  leaker  is  =  Pi  Pg.  Sup¬ 
pose  we  consider  a  sequence  of  attacks  that  each  result  in  a  proba¬ 
bility  of  a  leaker  being  •  The  number,  X,  of  enemy  cruise  missiles 
required  to  achieve  N i  successful  leakers  has  a  negative  binomial 
distribution: 


nx-.N^.PL) 


x  =  Ni,Ni+l,Ni-\-2, 


with  mean  N^d  -  P[)/ P[.  For  example,  if  we  let  the  single-shot 
probabUity  of  damage  be  pa  =  0.6,  and  let  the  fraction  of  damage 
required  to  disable  the  cruiser  be  p„  =  0.25,  then  the  expected  num¬ 
ber  of  leakers  required  to  disable  the  cruiser  is: 


ln(l-.25) 

ln(l-.6) 


=  0.3140. 


This  means  that  with  a  shoot-look-shoot  policy,  the  expected  num¬ 
ber  of  arrives  required  to  yield  enough  leakers  to  disable  the  cruiser 
(given  the  single-shot  kill  probability  of  an  interceptor  pg  =  0.7  and 
the  probability  that  an  attacking  missile  escapes  the  CIWS  is  pg  =  0.3) 


N^a-PL)  _  iVid-pA)  (.3140)(.91) 

PL  PePl  (.3)(l-.91)-^°-®- 


UNCERTAINTY  AND  KNOWLEDGE 

The  AN/SPY-1,  the  multifunction  phased-array  radar  at  the  heart  of 
the  Aegis  system,  can  detect  and  track  incoming  missiles  with  con¬ 
siderable  accuracy.  We  therefore  assume  that  the  probability  of  de- 


‘®The  result  is,  of  course,  purely  statistical.  This  expected  value  calculation  does  not 
take  into  account  that  a  cruise  missile  cannot  damage  more  than  one  ship.  At  least 
missile  hit  is  required  to  disable  one  Aegis  cruiser.  Under  the  condition 
that  the  damage  inflicted  by  a  single  cruise  missile  hit  is  expected  to  be  disabling 
(Pd)(Pa)r  N I  should  be  set  to  1.0.  ® 
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tection  for  any  enemy  missile  is  1.0  and  that  the  detecting  cruiser 
knows  the  enemy  missile’s  location,  speed,  and  trajectory  at  all 
times.  We  also  assume  that  the  friendly  decisionmakers  have  accu¬ 
rate  information  regarding  their  own  inventories  and  capabilities. 
The  only  thing  not  known  about  the  enemy  attack,  therefore,  is  the 
attack  distribution — that  is,  when  the  main  effort  of  the  attack  will 
arrive  or  how  long  it  will  last.  We  do  assume  that  the  friendly  forces 
know  the  enemy’s  missile  inventories  and  launch  capabilities.  Al¬ 
though  this  offers  no  information  on  the  attack  distribution,  it  does 
establish  an  upper  bound  on  the  attack  size. 

Gaining  knowledge  of  the  attack  distribution  means  obtaining  reli¬ 
able  estimates  for  the  arrival  rates,  Xifi  and  in  Figure  3.7.  These 
may  be  obtained  through  intelligence  sources  prior  to  the  attack  and 
from  other  sensors  (other  ships  in  the  area;  intelligence,  surveillance, 
and  reconnaissance— ISR— aircraft;  etc.)  during  the  attack.  Knowing 
the  character  of  the  attack  in  a  subinterval  allows  for  a  more  optimal 
response.  How  this  knowledge  affects  the  cruiser  and  infrastructure 
survival  rates  is  discussed  below. 


Uncertainty 

For  each  type  of  missile  (ballistic  missiles  and  cruise  missiles),  we  as¬ 
sume  that  the  size,  n,  of  the  enemy  missile  inventories  is  known. 
Therefore,  in  the  absence  of  any  information,  the  arrival  rate  in  each 
of  the  subintervals  is  estimated  to  be  if  =  With  perfect  infor¬ 

mation,  the  estimate  is  the  true  value,  or  Xi  =  Xf .  We  assume  that 
the  fraction  of  remaining  missiles  that  will  arrive  in  period  i  is  a  ran¬ 
dom  variable,  x,  with  a  beta  distribution^^  as  depicted  in  Figure  3.10. 

The  beta  probability  density  has  the  form: 


/(x;a,p) 


r(a-Hp) 

r(a)r(p) 


;ce[0,l] 


drop  the  c  and  b  subscripts.  The  analysis  is  the  same  for  both. 

^^Although  the  actual  missile  arrivals  distribution  is  discrete  (arrival  counts  are  integer 
values),  we  are  able  to  use  the  continuous  beta  distribution  since  our  analysis  is 
performed  in  an  expected  value  setting. 
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with  mean: 


E{x)  = 


a 

a+p 


and  variance: 


(a  +  p)^(a+p-Hl) 

For  a  =  p  =  1,  the  well-known  uniform  distribution  results  reflecting 
maximum  uncertainty.  For  a,  P  >  1,  the  distribution  has  a  mode: 


g-l 

a+p-2‘ 


Figure  3.10— Arrival  Rate  Uncertainty 
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For  purposes  of  this  analysis,  we  consider  only  those  distributions  for 
which  a,  p  >  1. 

The  maximum  number  of  arrivals  in  any  time  period,  i  =  1,2, ... ,  r ,  is 

That  is,  the  worst  case  is  that  all  remaining  missiles  arrive  simultane¬ 
ously.  Although  not  a  practical  consideration,  it  does  provide  an  up¬ 
per  bound  for  the  probability  distribution.  In  the  subsequent  dis¬ 
cussion,  we  drop  the  subscript  i.  It  is  understood  that  q  refers  to  the 
remaining  inventory  of  enemy  missiles  at  the  end  of  /  -  1  subinter¬ 
vals. 

The  arrival  rate  in  the  current  time  period  therefore  is  X  =  qx,  where 
q  is  the  known  inventory  of  remaining  missiles. If  E,x)  =  ^ ,  then  the 
expected  arrival  rate  in  the  current  time  period  is  E{X)  =  qEix)  =  q^. 
Since  ^  is  the  actual  fraction  of  the  remaining  inventory  scheduled  to 
be  launched  in  the  current  period,  we  need  to  choose  the  parameters 
of  the  beta  distribution,  a  and  p ,  such  that 


However,  because  an  infinite  number  of  combinations  of  a  and  p 
can  yield  an  unbiased  estimate,  we  choose  the  appropriate  values 
under  the  constraint  that  min(  a,  p)  >  1  (ensuring  that  a  mode  exists) 
and  such  that  the  resulting  variance  achieves  a  'Target  value’' 

The  target  variance  reflects  the  information  quality,  Q,  associated 
with  the  sensor  suite  used  to  produce  the  estimate  of  missile  arrival 
rate  for  the  current  period.  For  purposes  of  this  discussion,  informa¬ 
tion  quality  is  the  degree  to  which  the  information  is  current,  correct, 

^^Note  the  fact  that  the  random  variable  jc  is  the  fraction  of  remaining  missiles  that 
will  arrive  in  this  period  implies  that  x  is  really  a  fractional  arrival  rate— i.e.,  the  frac¬ 
tion  arriving  per  minute. 
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and  complete.  Therefore,  we  set  0  <  Q  <  1.  where  Q  =:  1  implies  the 
information  has  maximum  quality.^2 

Information  Entropy 

To  assess  the  degree  of  knowledge  present  in  a  density,  such  as  the 
one  just  described,  we  employ  the  concept  of  Information  entropy  or 
Shannon  entropy.  Information  entropy  is  a  measure  of  the  average 
amount  of  information  in  a  probability  distribution  and  is  defined  as: 


HW  =  -j2}n[nx)]f{x)dx.^^ 

Information  entropy  is  based  on  the  notion  that  the  amount  of  in¬ 
formation  in  the  occurrence  of  an  event  is  inversely  proportional  to 
the  likelihood  that  that  event  will  occur.  Thus  there  is  no  informa¬ 
tion  in  Orphan  Annie’s  declaration  that  "the  sun  will  come  up  tomor¬ 
row”  whereas  there  is  considerable  information  in  the  realization 
that  an  individual  has  won  the  national  lottery.  Because  entropy  is 
an  expected  value,  it  is  also  referred  to  as  the  average  information  in 
a  probability  density. 

Knowledge 

The  distribution  in  Figure  3.10  is  completely  defined  by  the  maxi¬ 
mum  time  period  arrival  rate,  q,  and  the  mean  arrival  rate,  X  =  q^. 
From  this  we  can  calculate  the  information  entropy,  or  the  uncer¬ 
tainty  in  the  distribution: 

H{x)  =  -(  f{x)\nf{x)dx 
Jx=0 

=  ln[B(a,p)]  -  (a  - 1)  [\|/(a)  -  \|/(a  -i-  P)  ]  -  (p  - 1)  [\|/(p)  -  y(a + p) ] , 


^^See  Appendix  A  for  a  more  thorough  discussion  of  “target  variance.”  For  a  more 
complete  discussion  of  information  quality,  see  Perry,  Signori,  and  Boon  (2001). 

Actually,  because  entropy  is  really  a  statistical  expectation,  the  quantity  should  be 
EUnifit))].  However,  in  most  texts  this  is  shortened  to  H{t)  and  we  adopt  this 
convention  in  this  report.  See  Shannon  (1948,  pp.  379-423  and  623-556) 
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where  \|/(c)  is  the  first  derivative  of  Euler’s  gamma,  and 


Bip^q) 


TipWig)  24 

T{p  +  q)  ‘ 


We  can  create  a  mapping  of  entropy  onto  a  [0,1]  knowledge  scale  by 
selecting  an  upper  bound  on  the  entropy  associated  with  the  frac¬ 
tion,  X.  Before  proceeding,  however,  we  note  that  the  uncertainty  as¬ 
sociated  with  the  fraction  of  the  remaining  missiles  arriving  in  the 
current  period  is  equivalent  to  the  uncertainty  associated  with  the 
estimated  arrival  rate,  X,orHiX)  =  Hix] . 

The  upper  bound  for  H{X),  denoted  H*iX),  occurs  when  a  =  p  =  1. 
That  is,  maximum  entropy  occurs  when  uncertainty  is  maximized. 
In  this  case,  therefore,  we  have  that  H*{X)  =  0,  a  natural  upper 
bound,  A  lower  bound  is  also  needed.  However,  minimum  entropy 
occurs  when  the  variance  is  minimized  or  when  a  and  P  are  very 
large  so  that  HiX)  -oo .  For  practical  purposes,  we  set  this  to  be  a  = 
p  =  12  for  which  H{X)=  -32.3192.25  ^an  define  knowledge,  there¬ 
fore,  as: 


H{X)  ^  HiX] 

H^^iX)  -32.3192* 

Note  that  the  maximum  time  period  arrival  rate,  q,  is  determined  by 
the  known  enemy  missile  inventory,  n,  and  the  attack  history.  A  nat¬ 
ural  maximum  value  for  q  therefore  is  the  known  enemy  missile  in¬ 
ventory.  This  presupposes,  of  course,  that  the  arrival  rates  for  all 
preceding  periods  were  0  and  that  the  entire  inventory  will  arrive  in 
the  next  time  period.^^ 

In  this  form,  knowledge  is  then  used  to  influence  the  decisions  taken 
subsequently  and  the  outcome  produced,  as  described  below.  First, 


2^See  Appendix  A  for  details  concerning  the  computation  of  this  quantity. 

25see  Appendix  A  for  a  more  detailed  treatment. 

^^This  also  ignores  the  fact  that  if  the  arrival  rate  up  to  now  is  0,  it  is  difficult  to  main¬ 
tain  that  the  attack  has  started! 
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however,  we  assess  the  effects  of  collaboration  and  network  com¬ 
plexity. 

COLLABORATION 

Collaboration  is  a  process  in  which  individuals  work  together  to 
achieve  a  common  goal.  It  is  important  because  it  enhances  the  de¬ 
gree  of  shared  awareness  in  a  group  focused  on  solving  a  specific 
problem  or  arriving  at  an  agreed  decision.  Several  reasons  point  to 
why  collaboration  might  be  expected  to  improve  the  degree  of 
shared  awareness,  including  the  potential  for  increased  sharing  of 
information  and  experience  as  well  as  synergy  of  inference.  How¬ 
ever,  other  factors  can  degrade  performance,  such  as  disruptive  in¬ 
teractions,  misunderstandings,  or  overvaluing  a  particular  point  of 
view  because  of  the  persuasiveness  or  authoritarian  role  of  an  indi¬ 
vidual  team  member.  For  this  reason,  the  opportunity  to  collaborate 
can  both  add  to  and  detract  from  effective  combat  operations.  Here, 
we  treat  the  contributions  only,  but  in  varying  degrees.  We  postpone 
a  discussion  of  the  negative  effects  for  future  research.^^ 

In  general,  as  the  opportunity  for  a  decision  team  to  collaborate  in¬ 
creases  (more  connections),  the  better  the  decision  is— provided  that 
the  quality  of  the  collaboration  is  good.  The  quality  of  human  col¬ 
laboration  can  depend  on  several  factors,  among  which  are  the  ex¬ 
perience  of  the  team,  the  amount  of  time  they  have  been  working 
together,  the  procedures  in  place  to  facilitate  collaboration,  the  per¬ 
sonalities  of  the  individual  members,  and  the  knowledge  the  team 
members  possess  about  the  critical  element(s)  of  the  operation.  28 
Here  we  deal  primarily  with  collaboration  among  automated  sys¬ 
tems— compressed  time  scales  might  not  accommodate  human  in¬ 
teractions. 

Figure  3.11  collects  the  three  operating  procedures  described  above 
for  reference.  The  degree  of  collaboration  and  the  complexity  of  the 
network  vary  considerably  among  the  three. 


For  a  fuller  discussion  of  collaboration  and  shared  awareness,  see  Perry,  Sienori  and 
Boon  (2001). 

2®See,  for  example,  Wegner  (1987,  pp.  185-208). 
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Platform-Centric:  Divided  Duties 


Network-Centric:  Common 
Operating  Picture 


Network-Centric:  Cooperative  Engagement 


Figure  3.1 1— Missile  Defense  Operating  Procedures 


A  Reliability  Model 

In  each  of  the  three  diagrams  in  Figure  3.11,  each  ship  is  depicted  as 
comprising  two  nodes:  one  representing  the  CIC  and  the  other  rep¬ 
resenting  the  SPY-1  radar.  “Collaboration”  between  the  two  consists 
of  passing  signals  to  the  radar  screen  in  the  CIC  and  receiving  signals 
from  the  CIC  to  adjust  the  radar’s  regard.  The  results  of  collabora¬ 
tion  here  are  shared  information  about  where  enemy  missiles  are  lo¬ 
cated  from  the  radar  and  where  to  look  next  from  the  CIC.^^  In  the 
two  network- centric  cases,  the  SPY-1  radars  are  connected  to  the 
CICs  in  both  ships.  In  these  cases,  the  additional  information  made 
available  by  this  dual  connection  is  considered  a  form  of  positive 
collaboration  and  thus  increases  the  reliability  of  the  assessment  of 


^^The  Office  of  the  Secretary  of  Defense’s  Information  Superiority  Metrics  Working 
Group  (ISMWG)  defines  collaboration  to  be  a  process  in  which  two  or  more  people 
actively  share  information  while  working  together  toward  a  common  goal.  See,  for 
example,  Alberts  et  al.  (2001,  pp.  27-28). 
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the  enemy  attack  distribution.  This  is  predicated,  of  course,  on  the 
assumption  that  the  information  exchanged  is  of  high  quality.  Fi¬ 
nally,  in  the  cooperative  engagement  case,  all  shipboard  nodes  are 
connected  to  the  central  control  facility,  thereby  increasing  the  op¬ 
portunity  for  positive  collaboration. 

Statistical  reliability  appears  to  be  an  appropriate  model  for  assess¬ 
ing  the  effects  of  collaboration.  First,  we  let  Cy(f)e  [0,1]  represent  the 
effects  of  collaboration  between  two  nodes  i  and  j,  where  t  is  the  time 
required  to  complete  the  collaboration.  The  problem  is  to  examine 
the  nature  of  the  functional,  (r),  for  each  collaborative  pair  and  for 
the  entire  network.  The  general  form  of  c,y(r)  is: 


where  r{s)  is  called  the  failure  rate  function  and,  in  this  case,  is  de¬ 
pendent  on  the  nature  of  the  collaboration.^o  Note  that  for  t  =  0, 
Cijit)  =  0.31  xhat  is,  with  no  time  to  collaborate,  it  is  impossible  to 
share  any  information.  With  more  time  to  collaborate,  we  would  ex¬ 
pect  to  experience  increasing  amounts  of  shared  information.  To  the 
extent  that  that  is  desirable,  more  time  to  collaborate  leads  to 
improved  benefits  from  that  collaboration. 

Note  that  Cy  (r)  can  be  viewed  as  a  cumulative  probability.  If  r  is  a 
random  variable  representing  the  time  required  for  a  successful  col¬ 
laboration,  then  CijltQ)  =  Pit<  fo). 

As  an  example,  suppose  we  have  a  complete  network  consisting  of 
three  nodes — 1,  2,  and  3.  The  three  nodes  therefore  generate  three 
collaborative  connections,  1-2,  1-3,  and  2-3.  Suppose  that  the  col¬ 
laboration  probabilities  for  these  three  pairs  are  determined  by  the 
foUowing  failure  rates:  ^2(5)  =  !,  r23(5)  =  2,and  ri3(5)  =  3.  From  this, 
we  discover  the  following  collaboration  probability  functions: 

3^^(Ve  used  fpreviously  to  represent  the  length  of  a  time  period.  Its  current  use  is  quite 
different. 

3^There  are  several  good  texts  on  reliability  engineering.  See  Ayyub  and  McCuen 
(1997)  and  Pecht  (1995),  for  example. 
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Figure  3.12 — Collaboration  Reliability  Curves 

c^2(^)  =  l-e“^  C23(t)  =  l-e"^,and  =  .  Figure 3.12 depicts 

varying  collaboration  probabilities  for  these  three  pairs. 

Note  that  the  time  at  Mrhich  successful  collaboration  between  two 
nodes  occurs  depends  on  the  form  of  its  failure  rate  function,  r(5).  In 
this  case,  a  constant  was  selected  because  we  can  model  earlier  suc¬ 
cessful  collaboration  by  simply  increasing  the  constant  value.  In 
general,  we  select  a  form: 

C,y(f)  =  l-e‘®'  forf>0. 

The  next  step  is  to  combine  the  collaboration  effects  before  assessing 
its  effect  on  knowledge  and  subsequently  the  success  of  the  defen¬ 
sive  missions.  Before  we  do  this,  however,  we  take  advantage  of  the 
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fact  that  Cijit)  is  a  cumulative  probability  and  calculate  its  density 
function: 


dcijit) 

dt 


Applying  this  to  the  three  collaboration  estimates  we  get: 


/12(f) =e~' 
/23(f)  =  2e-2' 
/23(f)  =  3e-3' 


These  are  exponential  distributions  with  1/6  being  the  mean  time 
available  for  nodes  i  and  j  to  collaborate  with  a  variance  of  (1/0)^. 

The  entropy  calculation  for  the  exponential  distribution  with  pa¬ 
rameter  0  is: 

Note  that  entropy  varies  with  the  variance  of  the  distribution  as 
should  be  expected.  As  1/  0  increases  (0  decreases),  Hit)  =  ln(e/0) 
also  increases.  Note  also  that  entropy  is  unbounded  for  this  distri- 

bution,32 

We  can  use  the  entropy  function  to  develop  a  measure  of  knowledge 
by  assessing  the  "certainty"  in  the  density  function.  This  requires  an 
approximate  upper  bound  to  be  assigned  to  Hit),  the  equivalent  to 
assigning  a  maximum  expected  time  to  complete  a  collaboration  If 
we  let  (l/0)n,ax  =  ^min  represent  the  maximum  expected  time,  then  a 
measure  of  certainty  or  knowledge  can  be  written  as: 


^^This  is  taie  for  all  continuous  distributions. 
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iC(f)  =  ln 


33 


Note  that  this  quantity  is  dimensionless  and  therefore  can  be  used 
directly  to  influence  combat  MOEs.  It  is  desirable,  however,  for  the 
measure  of  knowledge  to  be  normalized.  This  can  be  accomplished 
by  noting  that  when  6  =  emin » =  ln(l)  =  0  and  when  0  /  0inin  = 
K{t)  =  ln(e)  =  1.  This  suggests  the  following  definition  for  the  knowl¬ 
edge  gained  from  the  collaboration  between  nodes  i  and  j: 


0  if  0  <  0niin 

ln(e/0nii„)  ifenim^e<e9r 
1  ifesee^in 


34 


Note  that  for  small  values  of  0 ,  the  mean  and  variance  are  large,  thus 
implying  great  uncertainty  and  therefore  little  knowledge.  For  large 
values  of  0 ,  the  opposite  is  true  and  therefore  considerable  knowl¬ 
edge  is  gained.  Kijit),  therefore,  models  the  positive  effects  of  hav¬ 
ing  more  time,  on  average,  to  collaborate. 

The  next  step  is  to  develop  a  total  system  collaboration  factor  that 
accounts  for  all  pairs  of  collaborating  nodes.  The  goal  is  to  discern 
how  the  enemy  proposes  to  distribute  the  cruise  and  ballistic  mis¬ 
siles  over  the  t  time  periods.  This  means  that  the  knowledge  func¬ 
tion,  KiX),  calculated  earlier,  should  be  modified  by  incorporating 
the  effects  of  collaboration.  Although  collaboration  between  nodes 
in  each  of  the  three  cases  studied  can  occur  simultaneously,  it  is  nec¬ 
essary  that  all  node  pairs  collaborate.  This  makes  the  overall  system 
collaboration  model  sequential,  and,  therefore,  using  an  inverse  reli¬ 
ability  model  we  get  that  system  collaboration  is:^^ 


^^Because  the  term  K{t]  is  derivative  of  information  entropy,  we  extend  the  convention 
of  using  tas  the  functional  argument. 

^“^For  additional  information  on  the  use  of  information  entropy  as  a  measure  of 
knowledge,  see  Perry  and  Moffat  {1997,  pp.  965-972). 

^^It  is  sequential  as  opposed  to  parallel.  The  latter  would  occur  if  the  system  required 
that  collaboration  occur  between  nodes  a  andb  or  nodes  c  and  d,  but  not  both.  We  as¬ 
sume  that  collaboration  occurs  between  all  connected  nodes. 
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~  1  ^ij  )  • 

[ij] 


Therefore,  is  large  for  systems  with  several  collaborating  pairs. 
Using  the  knowledge  factor  for  each  collaborating  pair  derived  from 
the  collaboration  function  instead  of  the  collaboration  function  it¬ 
self,  we  get: 


li.n 

This  assumes  that  the  collaboration  effect  from  each  collaborating 
pair  is  equal  in  value.  The  effects  of  collaboration  then  can  be  repre¬ 
sented  using  a  linear  model: 

K,iX)  =  KMmi-K{X)]+K{X), 

where  K^iX)  is  the  knowledge  about  the  attack  distribution  that  ac¬ 
counts  for  collaboration  effects.  If  {t)  -  0,  there  is  little  or  no 
collaboration  effect.  On  the  other  hand,  when  it)  ^  I,  the  collab¬ 
oration  effect  is  “complete”  and  KciX)  =  1. 

COMPLEXITY 

A  well-connected  network  is  necessary  for  effective  command  and 
control,  but  it  is  not  sufficient.  For  this  reason,  we  refer  to  the  net¬ 
work  as  the  potential  energy  in  a  command  and  control  system.  The 
sufficient  condition  that  must  be  added  is  the  command  and  control 
process  that  operates  over  the  network.  This  is  the  kinetic  energy  of 
the  command  and  control  system  and  to  be  effective,  it  must  pro¬ 
duce  quality  information  and  allow  for  creative  command  and  con¬ 
trol  arrangements  that  are  reflected  in  good  combat  outcomes.  It  is 
always  possible  to  misuse  a  well-connected  network  and  to  effec¬ 
tively  use  one  that  is  not  well  connected. 

As  the  network  in  a  network-centric  operation  increases  in  size,  it 
also  increases  in  complexity.  This  stems  from  the  actual  and  poten¬ 
tial  connections  possible.  Unless  properly  managed,  this  complexity 
could  detract  from  the  mission  rather  than  support  it.  However, 
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there  are  cases  in  which  the  added  richness  in  connectivity  accom¬ 
panying  increases  in  network  size  can  enhance  operations.  Hence, 
complexity  as  collaboration  can  have  both  positive  and  negative  ef¬ 
fects. 

In  this  example,  collaboration  is  limited  to  the  two  CICs  and,  in  the 
cooperative  engagement  case,  with  the  central  controlling  authority 
as  well.  Complexity  is  generally  not  a  factor  in  these  simple  cases. 
Consequently,  we  defer  the  detailed  discussion  of  developing  the 
complexity  metric  to  Chapter  Four,  where  its  impact  is  considerably 
greater.  However,  Avith  the  addition  of  other  ships  in  the  area  partic¬ 
ipating  in  the  conflict  or  in  the  context  of  other  operations  in 
progress  affecting  the  two  cruisers  attending  to  missile  defense, 
complexity  might  become  an  important  factor.  For  that  reason,  we 
include  it  in  the  formulation.  Unlike  the  TCT  case  discussed  in  the 
next  chapter,  we  measure  the  effects  of  collaboration  and  complexity 
on  the  knowledge  function,  K{X).  Although  indirect,  the  effect  of  this 
process  on  combat  outcomes  is  still  measurable. 

A  Logistics  Model 

In  this  work  we  only  examined  the  degradation  in  performance 
stemming  from  complexity.  Although,  as  will  be  shovm,  we  can 
minimize  the  negative  effects  through  the  selection  of  appropriate 
parameters,  we  have  not  addressed  the  potential  synergies  that  may 
derive  from  a  complex  network  except  through  collaboration.  This 
remains  for  future  research. 

For  the  divided-duties  and  shared  COP  cases,  there  are  four  nodes 
with  a  maximum  of  six  connections,  and,  for  the  cooperative  en¬ 
gagement  case,  there  are  five  nodes  with  a  maximum  of  10  connec¬ 
tions.  Complexity  is  a  function  of  the  number  of  connections  in  a 
network,  and,  therefore,  we  let  this  be  the  independent  variable  in 
calculating  its  effects.  We  let  Cj;  represent  the  total  number  of  net¬ 
work  connections  for  each  of  the  three  cases:  v=  I,  divided  duties, 
V  =  2,  shared  COP,  and  =  3,  cooperative  engagement.  Conse¬ 
quently,  from  Figure  3.11  we  have  Ci  =3,  C2  =  5,  and  C3  =9.  The 
general  complexity  function  is: 
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36 


where  a  and  b  determine  both  the  region  of  minimal  impact  and  the 
size  of  the  region  of  rapidly  increasing  impact.  For  example,  for  the 
three  cases  described  in  this  analysis,  if  we  let  a  =  -  7  and  b  =  0.9,  we 
get  the  curve  depicted  in  Figure  3.13.  The  values  for  each  case  are 
identified  in  the  figure.^^ 


Figure  3.13 — Complexity 


^^his  curve  is  sometimes  referred  to  as  the  logistics  response  function  or  the  growth 
curve.  See  Neter  and  Wasserman  (1974).  See  Chapter  Four  for  a  more  detailed  devel¬ 
opment. 

^^The  value,  b  =  0.9,  in  this  example  is  significantly  higher  than  we  might  recommend 
in  practice. 
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We  would  expect  excessive  complexity  to  have  a  negative  effect  on 
our  ability  to  “know”  the  enemy  attack  distribution.  Therefore,  the 
combined  effects  of  collaboration  and  complexity  on  knowledge  is: 

This  is  now  used  to  modify  the  arrival  rate  estimates  at  each  time  pe¬ 
riod,  id  and  Recall  that  there  are  t  arrival  time  periods,  each  of 
which  is  t  minutes  in  duration.  The  total  number  of  cruise  missiles 
and  ballistic  missiles  in  the  enemy’s  inventory  is  and  riij,  respec¬ 
tively,  and  the  attack  horizon  is  r=  t  t  minutes.  With  no  information 
about  the  attack  distribution,  the  best  estimate  is  that  Xd  =  ric  I  ^and 
ibi  =  Ubl  T .  However,  with  perfect  information  we  have  that  Xd  = 
Xd  and  ibi  =  '^bi  >  the  true  arrival  rates.  The  following  functions  in¬ 
corporate  the  collaboration  and  complexity  modified  knowledge  to 
produce  the  desired  estimated  arrival  rates: 

ic={i-Kcc^a))^+K,c^(.x)Xc 

Xb={i-Kcc,a))^+K^^mb 


DECISIONS 

The  implementations  of  the  decisions  for  the  three  cases  described 
are  addressed  next.  For  all  three  cases,  one  of  the  ships, 
searches  for  cruise  missiles  and  the  other,  for  ballistic  missiles. 
The  decisions  center  on  the  allocation  policy  that  best  protects  both 
of  the  cruisers  and  the  critical  infrastructure  targets. 

Decisions  are  made  at  the  beginning  of  a  period  or  subinterval  de¬ 
pending  on  the  case. 

Remaining  inventories  of  Standard  missiles  on  each  ship  are  critical 
to  the  decision  process.  The  subinterval  consumption  rate  for  these 
missiles  depends  on  the  length  of  the  subinterval,  firing  rate,  shoot¬ 
ing  policy,  and  number  of  ships  engaging  each  missile.  The  number 
of  Standard  missiles  (ACM  and  ABM)  fired  at  each  enemy  missile  is 
reported  in  Table  3.1  and  repeated  for  convenience  as  Table  3.3.  The 
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Table  3.3 

Expected  Shots  Fired 


Mode 

Expected  Shots  Fired 
(Ef:f  =  {c,b}) 

One  Ship  Engaged 

Shoot 

Shoot-look-shoot 

Shoot-look-salvo  2 

Two  Ships  Engaged 

Shoot 

Shoot-look-shoot 

Shoot-look-salvo  2 

2 

4-  4pc  +  2p2 

6-  8pc  +  4p2 

NOTE:  In  this  table,  is  the  single-shot  proba¬ 
bility  that  the  enemy  cruise  missile  is  destroyed. 
These  values  are  reported  in  Table  3.1. 


number  of  Standard  missiles  required  to  destroy  an  enemy  missile  is 
denoted  by  the  term,  E f ,  where  the  subscript  denotes  either  ACMs  if 
=  c]  or  ABMs  (f  =  b).  Ef  is  slu  expected  value  and  is  therefore 
consistent  with  an  expected  value  analysis,  such  as  this  one. 


Platform-Centric:  Divided  Duties 

Only  the  role-switching  decision  is  modeled  for  this  case.  The  deci¬ 
sion  is  made  at  the  beginning  of  each  interval,  and  it  is  based  on  the 
remaining  inventories  of  ACMs  and  ABMs  on  board  each  ship  and 
the  estimated  remaining  attack  distribution.  For  a  ship  to  be  eligible 
to  assume  an  ACM  or  an  ABM  defense  role,  it  must  first  have  a  mini¬ 
mum  number  of  interceptors  of  the  appropriate  type  in  its  remaining 
inventory.  Next,  the  estimated  arrival  of  missiles  in  this  period  must 
be  enough  to  justify  the  switch. 

We  let  5c  be  the  minimum  number  of  ACMs  and  8^  be  the  number 
of  ABMs  needed  to  assume  those  defense  roles,  respectively.  In 
addition,  we  let  4^^  and  represent  the  remaining  inventories 
ofACMs  and  ABMs  on  board  Similarly,  4^^  and  represent 
the  remaining  inventories  of  ACMs  and  ABMs  on  board  .  Inven¬ 
tories  of  both  missile  types  on  board  both  ships  are  expected  to  be 
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reduced  by  Ef  per  incoming  missile  of  type/as  the  attack  proceeds. 
The  following  rules  then  apply: 

1.  When  to  Switch  Roles:  The  need  to  switch  roles  is  based  on  re¬ 
maining  inventories  of  Standard  missiles  on  either  of  the  defend¬ 
ing  cruisers.  Consumption  of  ACMs  on  the  ship  designated  to 
defend  against  cruise  missiles  and  consumption  of  the  ABM  in¬ 
ventories  on  the  ship  designated  to  defend  against  ballistic  mis¬ 
siles  are  factors.  A  need  to  switch  occurs  therefore  when  either 

<  6c  on  or  <  6^  on  or  both. 

2.  Designated  Ballistic  Missile  Ship,  :  If  a  need  to  switch  has 
been  established  (rule  1.  above),  and  if  the  number  of  ACMs  on 
board  exceeds  the  threshold  (4  ^  >  5^),  and  if  the  inventory  of 
ACMs  exceeds  the  estimated  number  of  cruise  missiles  arriving  in 
the  next  interval  ( 4^^  >  tidEc),  then  the  ballistic  missile  ship  will 
assume  a  cruise  missile  defense  role.^^ 

3.  Designated  Cruise  Missile  Ship,  If  a  need  to  switch  has  been 
established  (rule  1.  above),  and  if  the  number  of  ABMs  on  board 
exceeds  the  threshold  ( >5^),  and  if  the  inventory  of  ABM  mis¬ 
siles  exceeds  the  estimated  number  of  ballistic  missiles  arriving  in 
the  next  interval  (4^^  >  ti^yiEij),  then  the  cruise  missile  ship  will 
assume  a  ballistic  missile  defense  role. 

Network-Centric:  Shared  COP 

In  this  configuration,  both  ships  perform  ACM  and  ABM  roles.  With¬ 
out  coordination  of  fires,  both  ships  act  independently — but  with 
shared  information.  Each  ship  engages  the  targets  it  feels  it  can  best 
intercept.  Consequently,  it  is  possible  that  both  ships  respond  to  a 
given  enemy  cruise  or  ballistic  missile.  It  is  also  possible  that  both 
ships  decide  not  to  respond  to  a  given  threat.  Several  factors  com¬ 
bine  to  determine  how  often  either  of  these  cases  will  occur.  How¬ 
ever,  we  do  not  treat  them  explicitly  here.  Instead,  we  assume  that 
the  fraction  of  enemy  missiles  that  will  be  attacked  by  both  ships  is 
given  by  a  constant,  y  (we  allow  y  to  vary  parametrically). 


^^Note  that  tX^i  = 


where  5  is  the  number  of  subintervals  within  an  interval. 
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In  this  case,  decisions  are  made  at  the  beginning  of  each  subinterval. 
The  added  fidelity  is  needed  to  adequately  assess  the  effects  of  the 
decisions  taken. 

The  decision  to  engage  an  enemy  missile  is  based  primarily  on  the 
relative  geometry  (including  positions  and  heading)  of  the  ship  and 
the  enemy  missile.  However,  in  addition  to  the  relative  geometry, 
consideration  is  also  given  to  remaining  inventories  of  missiles  and 
the  anticipated  attack  arrival  rate  for  the  next  subinterval. 

In  general,  it  is  desirable  to  engage  a  threat  missile  as  early  as  possi¬ 
ble.  This  means  that,  unconstrained,  each  ship  desires  to  attack  in¬ 
coming  missiles  in  the  order  of  their  proximity  to  their  own  ship.  The 
constraints  on  this  behavior  is  the  need  to  husband  inventories.  The 
better  each  ship  is  able  to  anticipate  what  comes  next,  the  better  it 
can  deal  with  the  present  threat. 

The  following  decision  rule  takes  location,  inventories,  and  estimates 
of  the  future  attack  distribution  into  consideration.  We  focus  on  the 
cruise  missUe  threat  because  this  is  critical  to  the  survivability  of  the 
two  defending  ships.  The  same  analysis  is  applied  to  ballistic  mis¬ 
siles. 

•  Location:  Although  the  representations  in  this  analysis  do  not 
include  relative  geometry,  we  can  infer  location  through  the 
fraction  of  enemy  missiles  directed  at  each  of  the  cruisers  (a  for 
and  1  -  a  for  The  assumption  is  that  if  an  enemy 

cruise  missile  is  directed  against  either  ship,  it  is  likely  that  that 
ship  will  decide  it  is  in  the  best  position  to  engage  it.  However, 
7  percent  of  the  total  missile  arrivals  have  an  expected  impact 
point  that  threatens  both  ships — i.e.,  in  y  percent  of  the  cases, 
both  ships  feel  that  they  are  the  impact  point.  For  these  arrivals, 
decisions  are  based  on  both  ships  attempting  to  intercept.  The 
enemy  intent  is  to  aim  a  percent  of  the  cruise  missiles  at  A^^^ 
and  1  -  a  percent  of  the  cruise  missiles  at  A^^\  The  ship  A^^^ 
perceives  ^at  a-ay-i-y  percent  of  the  arrivals  are  aimed  toward 
it,  and  A^^^  perceives  that  (1  -  a)(l  -  y)  +  y  percent  of  the 
arrivals  are  aimed  toward  it.  An  individual  ship’s  decisions  are 
based  on  this  expected  arrival  allocation. 
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•  Inventories:  As  in  all  cases,  inventories  are  constraining.  If  the 
cruise  missile  attack  in  the  current  subinterval,  j, 


-Xci  enemy  missiles 
s 

absorbs  the  entire  inventory  of  ACM  or  7^^^)  weapons,  then 

nothing  will  be  left  to  defend  against  subsequent  attacks.^^  Con¬ 
sequently,  current  inventories  of  ACM  weapons  must  be  weighed 
against  the  current  attack  and  estimates  of  future  attacks: 


ST  f  - 


For  ballistic  missile  attacks,  a  similar  estimate  of  future  attacks  is: 


•  Future  attack  distribution  estimate:  The  nature  of  future  cruise 
missile  attacks  against  the  two  cruisers  affects  the  decision  to  en¬ 
gage  current  threats.  The  anticipation  of  a  more  intense  attack 
materializing  in  the  future  forces  both  ships  to  husband  their 
ACM  assets.  The  decision  would  be  to  let  the  CIWS  take  care  of 
incoming  missiles  more  likely  to  hit  their  targets.  We  use  the  pa¬ 
rameter,  0  <  u/  <  1,  to  indicate  how  much  weight  we  should  assign 
to  the  future  attack  in  our  allocation  decision. 

The  decision  rule  for  based  on  these  three  considerations 
therefore  is  to  engage  a  maximum  of  enemy  missiles  of  type 
f{f=  {c,  b]),  where  dy  is  defined  as  follows: 


^^Note  that  there  are  st  subintervals  in  the  attack  horizon,  where  s  is  the  number  of 
subintervals  in  an  interval  and  x  is  the  number  of  intervals. 
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n 


Otherwise, 


where  p^a-ay  +  y  when  /  =  c  and  p  =  1  when/=  b.  Similarly, 
for  ship  we  have  p  =  (i-a)(l-y)-hy  when/=  c  and  p  =  1  when 
f=b. 


Network-Centric — Cooperative  Engagement 

In  this  network  configuration  as  in  the  shared  COP  case,  the  decision 
to  be  made  is  which  ship(s)  {A^^\  A^^\  or  both)  should  attempt  to 
intercept  incoming  cruise  missiles  in  a  subinterval  and  how  many 
missiles  each  can  “safely"  engage  in  a  subinterval.  The  differences 
between  this  decision  and  the  shared  COP  case  are  as  follows:  in  this 
case,  a  central  control  authority  makes  the  decision  based  on  shared 
information  from  both  ships,  and,  in  the  cooperative  engagement 
case,  future  attack  distributions  are  considered  separately  for  each 
subinterval  rather  than  lumped  into  a  single  sum  of  future  arrivals 
(i.e.,  the  computation  of  F^).  In  the  COP  case,  instances  occur  where 
both  ships  attempt  to  intercept  the  same  cruise  missile  since  defen¬ 
sive  fire  is  not  coordinated.  In  the  cooperative  engagement  case, 
however,  there  are  also  instances  where  both  ships  attempt  to  inter¬ 
cept  the  same  cruise  missile.  This  occurs  because  the  controlling 
authority  has  determined  that  the  expected  remaining  ACM  operat¬ 
ing  life  for  the  remaining  Aegis  cruisers  is  longer  if  both  attempt  to 
intercept  in  the  current  subinterval.  The  controlling  authority  con¬ 
siders  the  current  attack  scenario,  future  expected  attacks,  and  the 
expected  life  of  each  Aegis  cruiser  that  will  result  under  different 
defensive  options.  In  the  cooperative  engagement  case,  the  objective 
of  the  controlling  authority  is  to  use  all  available  information  to  de¬ 
termine  the  cruise  missile  defensive  strategy  that  will  keep  the  ACM 
capabilities  of  the  remaining  Aegis  cruiser(s)  in  operation  for  the 
longest  period  (in  terms  of  subintervals). 
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It  is  likely  that  the  enemy  will  adopt  a  strategy  that  focuses  on  de¬ 
stroying  the  Aegis  cruisers  early,  thus  clearing  the  way  for  a  concen¬ 
trated  ballistic  missile  attack.  It  is  also  likely  that  the  friendly  cruisers 
will  be  positioned  to  provide  maximum  ballistic  missile  defense.  A 
longer  expected  period  of  ACM  operation  implies  that  there  is  more 
time  to  intercept  ballistic  missile  arrivals  and  to  protect  the  sister 
ship  from  arriving  cruise  missiles.  So,  the  cruise  missile  defense 
option  that  provides  the  longest  expected  ACM  operating  life  for  the 
surviving  cruisers  is  then  pursued  in  the  current  period.  As  in  the 
shared  COP  case,  our  focus  during  decisionmaking  is  on  defending 
against  cruise  missile  attack  on  the  defending  ships.  The  ballistic 
missile  defense  decisions  are  similar  but  of  secondary  importance. 
Whatever  time  and  resources  are  left  over  in  the  subinterval  will  be 
devoted  to  the  ABM  attack  mission.  Assuming,  as  usual,  that  the 
decision  is  to  be  made  at  the  start  of  subinterval  j,  we  first  calculate 
the  number  of  threatening  cruise  missiles  expected  to  arrive  in  each 
future  subinterval 


S 

With  this  and  the  information  assumed  available  to  the  decision¬ 
maker,  the  following  decision  inputs  are  used: 

•  Inventories:  As  in  the  shared  COP  case,  inventories  of  ACMs 
must  be  carefully  allocated  to  ensure  future  operation.  When  a 
ship's  cruise  missile  inventory  is  depleted,  it  may  no  longer  op¬ 
erate  in  an  ACM  role.  The  expected  attack  size  in  the  current 
subinterval  is 


the  absence  of  any  additional  information,  the  expected  number  arriving  in  each 
of  the  remaining  subintervals  is 


ST-j 


where  the  summation  on  the  numerator  is  the  total  number  of  enemy  cruise  missiles 
that  have  already  been  launched  in  the  preceding  ;  -  1  subintervals,  ric  is  the  total 
number  of  enemy  cruise  missiles  to  be  launched,  and  st  -  j  is  the  number  of  subinter¬ 
vals  remaining. 
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and  the  remaining  inventories  for  the  and  ships  are  4^^ 
and  4^^  ACMs  and  4^"^  and  4^^  ABMs,  respectively.  For  an  ex¬ 
pected  attack  distribution,  if  is  solely  responsible  for  ACM 
o|)erations,  its  inventory  of  ACMs  will  be  depleted  in  subinterval 
This  occurs  when: 


4^) 


{c)_v^  r- 


’(0 


In  the  formulation  of  4^^ ,  the  subscript  c  indicates  the  ship  is 
defending  against  cruise  missiles,  the  superscript,  (c),  is  the  ship 
whose  inventory  we  are  assessing  {A^^^  in  this  case),  and  the  ar¬ 
gument,  (c),  is  the  ship  defending  against  the  incoming  missiles. 

We  can  define  similar  measures  for  the  ship  and  for  the  case 
where  both  ships  are  performing  ACM  duties.  In  the  latter  case, 
we  assign  the  ACM  duties  to  the  ship  with  the  largest 
remaining  inventory,  or  when  v{b,c]  =  max{v[^\b,c),v[^hb,c)}. 
Note  that  the  expected  number  of  ACMs  fired,  {Ec{c),Ec{b),  or 
Ec[b,c)]  depends  on  the  number  of  ships  performing  ACM 
duties. 

•  Expected  Survivability:  The  survivability  of  each  ship  depends 
on  the  number  of  leakers,  (L),  the  single-shot  probability  that  an 
enemy  cruise  missile  will  damage  an  Aegis  cruiser  assuming  it 
strikes  the  cruiser  (p^),  and  the  fraction  of  damage  required  to 
disable  the  cruiser  [p^].  We  can  then  compute  the  number  of 
leakers  required  to  force  the  ship  out  of  commission  (OOC)  and, 
therefore,  render  it  unable  to  take  on  ACM  or  ABM  duties.  The 
number  of  Red  leakers  that  force  a  single  ship  to  be  OOC  is  Ni 
To  take  both  ships  OOC  (given  that  a  percent  of  the  cruise  mis¬ 
siles  are  aimed  at  A^^^  and  1  -  a  percent  are  aimed  at  A^^^),  a 
total  of 


The  formula  for  the  number  of  leakers  required  to  disable  an  Aegis  cruiser  is  dis¬ 
cussed  above  under  the  “Terminal  Defense  Queue"  subhead. 
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^  min(a,l-a) 

leakers  are  needed  to  disable  both  ships.  At  the  beginning  of 
subinterval  7,  we  compute  the  quantity: 

MAr)  = - - - - , 

a-PKirmi-Pciws) 

the  additional  threatening  ACMs  that  must  be  launched  by  the 
enemy  in  order  to  force  both  ships  to  be  taken  OOC,  where: 

1,  Lj  is  the  number  of  leakers  up  to  the  beginning  of  time  pe¬ 
riod;. 

2  PjcCr)  is  the  effective  probability  of  kill  that  can  be  achieved 
*  by  the  ACMs  with  r  defending  ships  given  a  fixed  shooting  pol¬ 
icy. 

3.  Pciws  is  probability  for  the  CIWS. 

Because  the  probability  of  kill  for  their  ACMs  and  CIWS  is  the 
same  for  both  ships,  Mj  (1)  is  the  same  for  both  and  . 
Also,  we  know  that  Mj  (1)  <  Mj  (2).  For  an  expected  attack  dis¬ 
tribution,  the  period  when  both  ships  are  OOC,  assuming  only 
one  performs  cruise  missile  defense  and  has  an  adequate  inven¬ 
tory  and  firing  rate  to  attempt  intercept  of  all  missiles,  is  the  sub- 
interval,  k  (1).  This  occurs  if  the  following  equality  is  satisfied: 

When  both  ships  defend,  then  the  period  when  both  ships  are 
OOC  is  the  subinterval,  k  (2),  that  satisfies 


M..(2)=y”  ix, 

J  s 


64  Measures  of  Effectiveness  for  the  Information-Age  Navy 


Given  these  values  at  the  beginning  of  period  j  and  the  objective  of 
maximizing  the  duration  of  ACM  operating  life,  a  decision  regarding 
the  number  of  ACM  defenders  is  made.  It  is  assumed  that,  once  as¬ 
signed  to  an  ACM  defense  role,  the  ship  will  attempt  to  intercept  ev¬ 
ery  incoming  cruise  missile  in  the  current  subinterval  without  regard 
to  future  attacks  (future  attacks  have  already  been  incorporated  in 
the  decision).  The  resulting  decision  rules  are  depicted  in  Table  3.4. 

This  decision  matrbc  implies  that  the  priority  is  to  extend  the  ACM 
operating  life  of  both  ships.  Where  all  cruise  missile  defense  possi¬ 
bilities  lead  to  the  same  expected  ACM  operating  life,  both  ships  are 
assigned  ACM  roles  to  achieve  higher  kill  probabilities.  Finally,  when 
it  is  decided  that  only  one  ship  should  perform  ACM  defense,  the  role 
is  assigned  to  the  ship  with  the  largest  ACM  inventory. 

The  assignment  rules  for  ballistic  missile  defense  do  not  account  for 
survivability  of  the  two  ships.  In  this  simple  assessment,  we  neither 
track  the  relative  survivability  of  the  infrastructure  targets  nor 
attempt  to  prioritize  them.  Therefore,  we  assume  that  all  infrastruc¬ 
ture  targets  are  to  be  defended  equally.  We  construct  the  simple 

Table  3.4 

Ship  Assignment  Decision  Rules  for  Cruise  Missile  Defense 


Comparison _  Assignment 

minMb,c),K(2)}>  min{4^^(c),K(l)}  and  Assign  mission  to  both  ships 
mm{v{b,c),K{2)}  > 


minMI?,c),K(2)}<  min{t'^^^(c),K(l)}  and  Assign  mission  to 
min{j/[^^(l7),K(l)}  <  min{4‘^^(c),K(l)} 

min{t<b,c),K(2)}<  min{y[^^(l7),K(l)}  and  Assign  mission  to 


minMl7,c),K(2)}<min{4^^(l7),K(l)}  and 
min{y(I?,c),K(2)}<  min{4'^^(c),K(l)}  and 
min{4^^(i?),K(l)}  =  min{4‘^^(c),K(l)} 


Assign  mission  to  A^^^  if 
>  I'c^ox  assign  mission 
to  A^^hf 
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decision  rule  that  both  ships  will  attempt  to  intercept  all  incoming 
TBMs  as  long  as  they  survive  and  have  not  depleted  their  inventory 
ofABMs. 

SUMMING  UP 

In  this  chapter,  we  have  linked  the  effectiveness  of  the  two  Aegis 
cruisers  in  defending  against  both  the  cruise  missile  and  ballistic 
missile  threat  to  £ilternative  command  and  control  processes  and  to 
alternative  operational  networks.  To  do  this,  it  was  first  necessary  to 
establish  adequate  measures  of  effectiveness  and  performance. 
Next,  we  developed  mathematical  models  of  collaboration  and  net¬ 
work  complexity  to  assess  the  performance  of  the  alternative  com¬ 
mand  and  control  procedures.  Finally,  these  models  were  used  in  an 
allocation  decision  process  that  directly  influenced  the  survivability 
of  the  cruisers  and  the  infrastructure  targets  they  were  defending. 

The  Measures 

In  this  vignette,  the  Aegis  cruisers  are  given  two  missions:  defend 
against  cruise  missile  attacks  against  themselves  and  prevent  enemy 
ballistic  missiles  from  destroying  key  allied  infrastructure  targets. 
For  both  missions,  the  measure  of  success  or  MOE  is  survivability— 
that  is,  the  fraction  of  the  critical  infrastructure  targets  that  survive  the 
attack  and  the  ''fraction"  of  the  cruisers  that  survive  the  attack. 

The  defending  ships  can  detect,  identify,  and  track  attacking  enemy 
missiles.  What  they  are  less  able  to  do  is  predict  how  the  enemy  will 
distribute  these  missiles  over  time.  Knowing  the  attack  distribution 
contributes  directly  to  the  allocation  of  missile  interceptors  and 
therefore  to  the  survivability  of  both  the  cruisers  and  the  friendly  in¬ 
frastructure  targets.  A  measure  of  how  well  the  alternative  command 
and  control  procedures  and  networks  perform  (MOP)  therefore  is  the 
degree  to  which  the  friendly  commander  "knows”  the  enemy's  attack 
distribution. 

The  Metrics 

Network  complexity  and  collaboration  are  combined  to  provide  an 
estimate  of  the  number  of  cruise  and  ballistic  missiles  expected  to 
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arrive  in  the  next  and  subsequent  time  periods.  These  estimates  are 
then  used  in  the  allocation  decision  rules  for  each  of  the  three  alter¬ 
native  command  and  control  processes  and  network  configurations. 
The  estimates  are: 

The  terms  Xc  and  X^  are  the  current  estimates  of  attacking  cruise 
and  ballistic  missiles  respectively.  (A.)  represents  the  knowledge 
about  the  attack  distribution  informecf  by  the  complexity  of  the  net¬ 
work  and  the  collaboration  that  has  taken  place.  The  subscript  v 
refers  to  the  case  being  examined  (i;  =  1:  platform-centric,  v  =  2: 
COP,  and  v  =  3:  cooperative  engagement),  X^  and  X^  are  the  true 
attack  distributions,  and  and  are  the  attack  sizes  for  cruise  and 
ballistic  missiles  to  be  launched  over  a  total  of  T  minutes.  The 
knowledge  function  is  bounded  between  0  and  1  with  K^c  (X)  =  1 
representing  perfect  knowledge.  When  this  occurs,  X^  =  V/  and 
Xbi  =  Xjyi  and  \yhen  knowledge  is  poor  (Kcc^^iX)  =  0)  we  have  that 
Xci  =  IT  and  Xfji  =  rib  IT.  This  last  case  means  that  our  estimate  is 
that  the  missiles  are  uniformly  distributed  over  the  attack  horizon,  T. 
These  equations  are  the  measure  of  performance. 


Chapter  Four 

A  TIME-CRITICAL  TARGET 


A  time- critical  target  (TCT)  is  one  with  a  limited  window  of  vulner¬ 
ability  or  engagement  opportunity  during  which  it  must  be  found, 
located,  identified,  targeted,  and  engaged.  Perhaps  the  most  familiar 
TCTs  are  mobile  theater  ballistic  missile  (IBM)  launchers,  which  can 
“shoot  and  scoot."  In  general,  they  can  be  detected  while  they  are 
moving;  in  their  “hides,"  they  are  relatively  invulnerable.  Once  the 
target  is  detected,  a  friendly  weapon  system  must  engage  it  before  it 
returns  to  its  hide. 

The  problem  we  are  addressing  in  this  chapter  is  that  of  an  enemy 
submarine  leaving  port  that  is  expected  to  submerge  shortly.  Like  a 
stationary  Scud  launcher,  a  surfaced  submarine  is  highly  vulnerable. 
Submerging  increases  the  difficulty  of  detecting,  classifying,  localiz¬ 
ing,  and  killing  it.  For  our  example,  we  assume  that  the  enemy  sub¬ 
marine  is  detected  as  it  leaves  port  and  that  an  aircraft  (or  an 
Unmanned  Combat  Aerial  Vehicle — UCAV — in  the  futuristic  case) 
will  use  this  cueing  data  (along  with  any  subsequent  updating  data) 
as  it  tries  to  attack  the  submarine  before  it  submerges. 

We  begin  with  a  description  of  the  vignette  in  the  context  of  the  gen¬ 
eral  scenario  presented  in  Chapter  Two.  Next,  we  present  three  al¬ 
ternative  operating  procedures  and  command  and  control  structures 
designed  to  solve  the  problem.  Finally,  we  apply  measures  and  met¬ 
rics  of  complexity  and  collaboration  to  each  alternative  and  assess 
the  impact  each  has  on  the  ability  to  destroy  the  enemy  submarine. 
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INITIATING  EVENTS 

On  D+5  of  the  conflict,  a  U.S.  Los  Angeles- class  SSN  destroys  an  en¬ 
emy  attack  submarine  (SS)  operating  in  the  SLOCs  northeast  of  the 
island.  The  enemy  submarine  commander  was  not  able  to  report  the 
attack  to  his  headquarters  on  the  mainland  before  sinking. 

On  D+6,  a  Virginia- class  SSN  begins  a  previously  planned  ISR  mis¬ 
sion  off  the  enemy  coast  near  the  destroyed  submarine’s  home  port. 

Because  the  enemy  is  accustomed  to  irregular  communications  with 
its  deployed  submarines,  it  does  not  realize  that  its  submarine  has 
been  killed  until  D+7.  On  D+8  a  Kilo-class  SS  is  ordered  to  replace 
the  destroyed  submarine.  Kilo  preparation  begins  the  same  day  and 
“overhead”  images  indicate  that  the  Kilo  is  preparing  to  go  to  sea.  Its 
time  of  departure  cannot  be  determined  from  the  imagery.  However, 
the  Commander  of  the  U.S.  Joint  Task  Force  (CJTF)  is  advised  of  the 
Kilo's  impending  departure  and,  in  turn,  advises  selected  units. 

A  plan  is  devised  to  kill  the  Kilo  on  the  surface  as  it  emerges  from  the 
harbor  without  revealing  the  ISR  submarine.  An  F/A-18  fighter- 
attack  aircraft  will  be  vectored  to  the  Kilo  and  will  kill  it  using  a 
Standoff  Land-Attack  Missile-Extended  Response  (SLAM-ER)  mis¬ 
sile.^  The  SLAM-ER  will  be  guided  to  the  area  of  the  Kilo  using  a 
combination  of  the  global  positioning  system  (GPS)  and  an  inertial 
navigation  system  (INS),  and  will  acquire  and  kill  it  using  an  electro- 
optical  passive  seeker.  The  performance  of  this  weapon  depends  on 
the  accuracy  with  which  target  position  is  known  at  launch,  with  up¬ 
dates  generated  by  the  ISR  submarine.  An  F/A-18  is  prepared  and 
placed  in  “Alert  5”  status — it  can  be  launched  on  five  minutes’  notice. 
If  necessary,  the  ISR  SSN  will  step  in  and  kill  the  Kilo  even  if  this 
means  compromising  the  ISR  mission. 


The  SIAM-ER  is  a  high  subsonic  sea-skimming  missile  with  the  same  electro-optical 
seeker  as  the  AGM-64  Maverick  (made  famous  in  Operation  Desert  Storm).  It  uses  the 
same  cockpit  display  as  the  Maverick.  It  can  work  through  object  recognition  or 
through  laser  designation.  In  operation,  crosshairs  are  laid  over  the  target  the  pilot  is 
able  to  see.  The  SLAM-ER  then  guides  itself  to  the  designated  target.  If  the  target's 
area  of  uncertainty  (AOU)  is  excessive,  the  SLAM-ER  electro-optical  sensor  may  be 
unable  to  pick  it  up.  In  this  case,  the  pilot  can  guide  the  SLAM-ER  to  reattack  and  try 
again. 
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The  Kilo  leaves  port  on  D-i-10  under  cover  of  darkness  and  is  detected 
by  the  ISR  submarine.  Seeing  the  Kilo's  position,  course,  and  speed 
on  the  surface,  the  ISR  submarine  estimates  the  remaining  time  until 
the  Kilo  submerges. 

Figure  4.1  summarizes  the  initial  events. 

From  this  point,  events  are  examined  from  the  perspectives  of  1980s 
platform- centric  procedures,  a  current  network- centric  procedure, 
and  a  futuristic  network-centric  procedure  using  a  UCAV  in  place  of 
theF/A-18. 

MEASURES  OF  PERFORMANCE  AND  EFFECTIVENESS 

The  paramount  objective  of  the  U.S.  forces  is  to  keep  the  enemy  Kilo 
from  reaching  the  SLOG  north  of  the  island.  The  JTFC  has  deter¬ 
mined  that  this  can  best  be  accomplished  by  catching  it  on  the  sur¬ 
face  and  attacking  it  as  early  as  possible.  Nevertheless,  the  decision 
he  must  make  is  whether  to  dispatch  an  F/A-18  armed  with  a  SLAM- 
ER  to  attack  the  Kilo  or  leave  it  to  the  Virginia-cldiss  SSN  even  though 
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NOTE:  The  circular  fans  along  the  enemy  coast  represent  the  extent  of  the  enemy's 
SAM  coverage. 


Figure  4.1 — Initial  Events 
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it  is  not  considered  to  be  the  best  platform  to  do  this,  given  that  its 
torpedoes  are  not  optimized  for  shallow  water.  In  addition,  the  at¬ 
tack  by  the  SSN  would  give  it  away  and  compromise  the  ISR  mission. 
The  enemy  will  be  unable  to  infer  the  source  of  targeting  data  relayed 
to  attacking  aircraft.  The  decision  therefore  hinges  on  the  JTFC’s  as¬ 
sessment  of  the  time  available  to  him  to  pursue  the  airborne  option. 

The  command  and  control  MOP  selected  for  this  analysis  is  Time  on 
Target — i.e.,  the  time  available  to  an  attacking  aircraft  to  conduct  its 
attack  measured  as  the  time  elapsed  between  its  arrival  on  station 
and  the  Kilo’s  submerging.  Since  the  actual  time  the  submarine  will 
submerge  is  not  known  to  the  CJTF,  an  earlier  arrival  time  is  better 
than  a  later  one. 

The  combat  MOE  is  the  probability  that  the  aircraft  destroys  the  Kilo 
given  that  it  arrives  on  station  before  the  Kilo  submerges.  The  oper¬ 
ational  impact  on  the  ISR  mission  is  measured  in  terms  of  hours  of 
ISR  mission  lost  to  supporting  an  attack  against  the  Kilo,  given  that 
the  aircraft  is  unable  to  engage  the  target. 

ALTERNATIVES 

Three  alternative  operating  procedures  were  developed  to  analyze 
this  problem.  Each  makes  assumptions  about  C4ISR  systems,  con¬ 
nectivity,  and  weapon  systems.  The  first  assumes  little  connectivity 
and  platform-centric  operations.  The  second  assumes  a  richer  net¬ 
work  but  with  only  slightly  altered  processes  and  equipment.  The 
third  assumes  a  richly  connected  network  with  new  operating  proce¬ 
dures  and  weapon  systems.  All  three  are  defined  below. 

Platform- Centric  Operations 

Figure  4.2  depicts  what  is  essentially  a  1980s  platform-centric  ap¬ 
proach  to  the  submarine  detection  and  acquisition  problem.  In  this 
operational  structure,  the  ISR  SSN  reports  up  the  chain  of  command 
to  the  operational  commander  who  then  alerts  the  CVBGs  that  a 
threat  submarine  has  left  port  (steps  2  and  3  in  the  figure).  There  is 
no  direct  communications  between  the  F/A-18  and  the  ISR  SSN. 
Note  also  that  the  operational  commander  does  not  control  the  ISR 
SSN,  although  periodic  two-way  communications  is  possible. 
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Figure  4,2 — Platform-Centric  Operations 


We  assume  that  prior  to  the  operation,  the  two  carriers  (one  nuclear- 
powered  carrier — CVN — and  one  conventionally  powered  carrier — 
CV)  negotiate  to  determine  which  will  provide  the  'heady”  aircraft, 
that  is,  the  aircraft  that  will  be  on  strip  alert  ready  for  launch  within 
five  minutes  (step  1  in  the  diagram).  In  this  case,  the  CV  is  selected. 

The  CJTF  develops  the  attack  plan,  using  an  F/A-18  armed  appro¬ 
priately  and  placed  in  "Alert  5”  status  on  the  CV  (step  4  in  the  dia¬ 
gram).  In  this  plan,  an  F/A-18  would  fly  out  and  attack  the  Kilo  from 
outside  the  SAM  envelope  (see  Figure  4.1)  using  a  SLAM-ER  missile 
(from  a  range  of  up  to  150  nautical  miles).  The  SLAM-ER  will  fly  out 
to  the  estimated  position  of  the  Kilo. 

The  F/A-18  flies  out  to  its  launch  point  under  operational  control  of 
the  carrier,  which  may  determine  that  the  threat  to  the  aircraft  is  ex¬ 
cessive  and  abort  the  mission  (step  5  in  the  diagram). 

The  ISR  SSN  will  continue  to  provide  updates  on  the  Kilo’s  position, 
course,  and  speed,  but  they  will  reach  the  F/A-18  through  the  opera- 
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tional  commander  as  with  the  initial  message  and  therefore  the  up¬ 
dates  are  likely  to  be  considerably  late  {step  6  in  the  diagram). ^ 

Figure  4.3  summarizes  the  details  of  the  SLAM-ER  attack  and  possi¬ 
ble  reattack. 

Command  and  control  in  this  platform-centric  case  is  split  awk¬ 
wardly  between  the  SSN  and  air  operations  on  the  carrier.  The  SSN 
might  see  an  indication  that  the  Kilo  was  about  to  submerge  and  at¬ 
tack  it  without  notifying  the  other  units.  In  this  case,  the  aircraft 
would  continue  on  toward  a  launch  point  and  might  go  on  to  an  at¬ 
tack  based  on  the  last  known  Kilo  position,  course,  and  speed. 

Air  operations  would  vector  the  aircraft  and  feed  it  the  latest  update 
data.  It  could  determine  that  the  threat  level  to  the  aircraft  was 
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Figure  4.3— Kilo  Attack  Operations  Using  SLAM-ER 


The  diagram  with  shaded  and  white  nodes  at  the  left  in  Figure  4.2  is  a  network  de¬ 
piction  of  the  connectivity.  The  shaded  nodes  represent  entities  directly  involved  in 
the  operations,  and  the  white  nodes,  although  connected,  represent  facilities  or  com¬ 
bat  entities  that  either  monitor  only  or  provide  information.  This  same  depiction  is 
repeated  in  subsequent  diagrams. 
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becoming  excessive  and,  in  that  case,  abort  the  mission.  This  would 
cause  air  operations  to  notify  the  operational  commander  that  the 
aircraft  mission  was  aborted  and  that  data  would  be  passed  to  the 
ISR  submarine.  The  ISR  submarine  would  ideally  attack  when  the 
aircraft  mission  is  aborted.  Instead,  in  this  vignette,  it  continues  to 
pass  target  updates. 


NETWORK-CENTRIC  OPERATIONS 

In  this  second  case,  the  connectivity  among  the  participants  is  richer, 
as  depicted  in  Figure  4.4.  The  V/rgmza-class  ISR  submarine  has  two- 
way  communications  (via  Link  16)  to  the  carriers.  As  in  the  platform - 
centric  case,  the  ISR  submarine  also  has  two-way  communications  to 
its  operational  commander,  but  these  communications  can  be  re¬ 
garded  as  "courtesy  copies.”  The  fact  that  the  ISR  submarine  has 
direct  communications  to  the  controlling  carrier  (and  the  deploying 
aircraft)  obviates  the  need  to  rely  on  the  operational  commander  to 
relay  messages.  Nevertheless,  the  operational  commander  monitors 
communications  with  the  SSN. 


Figure  4.4 — Network- Centric  Operations 
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The  controlling  carrier  uses  two-way  communications  with  the  F/A- 
18  to  control  its  operation  and  to  confirm  threat  status  updates.  The 
F/A-18  receives  periodic  target  updates  directly  from  the  ISR  subma¬ 
rine  with  latency  stemming  mainly  from  security  considerations 
(steps  4  and  5  in  the  figure). 

As  in  Figure  4.3,  the  F/A-18  will  fly  outside  the  SAM  coverage  enve¬ 
lope  to  the  SLAM-ER  launch  point  and  then  guide  the  missile  to  Kilo 
acquisition.  Relative  to  the  platform- centric  process,  the  area  of  un¬ 
certainty  has  been  reduced  to  just  over  one  square  nautical  mile. 

The  command  and  control  architecture  for  this  version  of  network¬ 
centric  operations  has  the  same  divisions  as  the  previous  platform¬ 
centric  operation  architecture  but  the  consequences  of  this  division 
are  considerably  reduced.  For  example,  the  ISR  submarine  may  still 
decide  on  its  own  that  the  Kilo  is  about  to  submerge  and  that  the 
aircraft  cannot  attack  in  time  and  so  attack  the  Kilo  itself.  However, 
with  communications  directly  to  the  carrier,  the  aircraft  can  be 
turned  back  earlier. 

Similarly,  if  air  operations  determines  that  the  threat  level  to  the  F/A- 
18  is  excessive,  the  aircraft  can  be  turned  back  unilaterally.  The  ISR 
submarine  can  be  alerted  to  the  situation  in  its  next  communication 
cycle,  and  therefore  it  will  have  more  time  to  attack  the  Kilo  itself. 

Future  Network-Centric  Operations 

The  Navy’s  UCAV  concept  is  currently  under  consideration  by 
the  Office  of  Naval  Research  (ONR).3  UCAVs  are  designed  to  be 
launched  from  a  variety  of  surface  combatants  in  theater  and  would 
therefore  be  an  attractive  option  in  this  scenario,  in  that  it  would  re¬ 
lieve  the  Navy’s  burden  of  keeping  an  F/A-18  (and  a  catapult)  on 


The  UCAV  is  designed  to  be  a  highly  maneuverable,  autonomous,  Vertical  and/or 
Short  Takeoff  and  Landing  (V/STOL)  aircraft  capable  of  operating  from  air-capable 
ships  (other  than  carriers).  It  will  provide  multimission  capability  including  surveil¬ 
lance,  target  recognition,  and  air  combat  to  the  mother  ship.  This  will  involve  the  de¬ 
velopment  of  intelligent  control  for  vision-based  navigation,  guidance  and  control, 
self- optimizing,  learning  control  schemes  accepting  input  from  multiple  sensory 
agents  and  from  hierarchies  of  decisionmaking,  and  intelligent  augmentation  for  hu¬ 
man-centered  decisionmaking.  See  http://robotics.eecs.berkeley.edu/-sastry/onr. 
ucav/ prop/ node2.html  for  more  information. 
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Alert  5  status  for  days.  For  the  purpose  of  NCW  analysis,  we  assume 
that  a  UCAV  will  be  developed  and  deployed  by  the  2010  time  frame,^ 

Figure  4.5  depicts  the  operating  environment  with  UCAVs  deployed 
on  a  destroyer  and  a  cruiser  in  the  theater  of  operations.^  Note  the 
increase  in  connectivity  among  the  participants  in  this  case  from  the 
notional  diagram  in  the  lower  left  of  the  figure  and  the  geographical 
depiction. 

After  the  ISR  submarine  detects  the  Kilo  coming  out  of  port  it  alerts 
all  potential  UCAV  launch  ships  within  the  limits  of  its  security 
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Figure  4.5 — Future  Network-Centric  Operations 


^At  the  time  this  research  was  conducted,  Navy  plans  were  as  stated  in  the  text.  How¬ 
ever,  the  Navy  with  Defense  Advanced  Research  Projects  Agency  (DARPA)  support  has 
since  moved  toward  a  UCAV  platform  of  aircraft  proportions  that  could  only  operate 
from  aircraft  carriers. 

^In  principle,  several  other  surface  combatants  might  carry  the  UCAVs.  However,  for 
simplicity,  we  focus  on  the  two  platforms  only. 
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concerns  (step  1).  The  ships  receiving  the  message  negotiate  to 
determine  which  can  get  a  UCAV  to  the  Kilo  first  (step  2).  The  time  to 
launch  a  UCAV  and  UCAV  fly-out  times  would  be  the  determining 
factors. 

In  arriving  at  a  decision,  the  combatants  with  UCAVs  collaborate 
with  each  other  and  vdth  other  facilities  with  information  needed  to 
arrive  at  a  best  solution.  Such  issues  as  who  makes  the  final  selec¬ 
tion,  who  determines  when  sufficient  collaboration  has  occurred, 
what  prior  designations  have  been  made,  what  is  the  polling  fre¬ 
quency,  and  who  determines  which  combatants  with  UCAVs  are 
candidates  are  command  and  control  procedural  questions  that 
must  be  addressed  and  evaluated  analytically. 

A  UCAV  is  then  launched  and  begins  its  fly-out  to  the  Kilo  area  of 
uncertainty  (AOU)  (step  3). 

The  ISR  submarine  takes  over  control  of  the  UCAV,  including 
weapon  release  (step  4).  If  the  ISR  submarine  realizes  that  it  must 
attack  the  Kilo  due  to  the  UCAV’s  late  arrival,  the  UCAV  will  be 
turned  back  at  the  next  communications  cycle.  If  the  submarine  de¬ 
termines  that  the  risk  of  losing  the  UCAV  is  becoming  excessive  (i.e., 
that  UCAV  probably  will  not  survive  to  the  launch  point),  it  can  con¬ 
duct  the  attack  and  turn  back  the  UCAV  itself  much  more  quickly. 

The  command  and  control  architecture  for  this  case  is  unsettled. 
Several  options  are  available,  and  three  of  these  are  listed  in  Table 
4.1.  The  impact  of  each  option  listed  in  the  table  is  somewhat  specu¬ 
lative.  However,  these  (and  other  possibilities)  constitute  the  basis 
for  conducting  exploratory  analysis  to  determine  the  effects  of  each 
on  combat  outcomes.  The  results  of  the  analysis  of  these  three 
options  and  several  variants  are  reported  in  Chapter  Five. 

In  addition  to  the  options  listed  in  Table  4.1  are  those  associated  with 
decentralized  command  and  control.  For  example,  it  is  possible  to 
establish  objective  response  criteria  a  priori  and  apply  them  at  exe¬ 
cution  time.  With  all  ships  sharing  the  same  COP,  each  can  deter¬ 
mine  the  ship  most  suitable  to  respond  without  the  intervention  of  a 
centralized  authority  in  some  form  of  a  bidding  process.  True  decen¬ 
tralized  execution  then  is  based  on  negative  control  procedures,  i.e.. 
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Table  4.1 

Future  NCW  Command  and  Control  Variants 


Option 

Process 

Impact  on  Operations 

Complete  polling 
at  execution  time 

Poll  all  potential  com¬ 
batants  with  UCAVs  and 
select  the  one  that  can 
get  to  the  target  quickest 

Large  cost  in  collaboration 
time 

Fastest  fly-out  time  for  UCAV 
after  decision  is  taken 

Periodic  selection 
of  a  subset  of 
combatants  with 
UCAVs 

Poll  a  select  subset  of 
combatants  with  UCAVs 
considered  to  be  in  the 
best  position  to  respond. 
Repeat  this  process  peri¬ 
odically 

Less  cost  in  collaboration  time 

Moderate  increase  in  fly-out 
time  for  UCAV  after  decision 
is  taken 

Periodic  complete 
polling  of  com¬ 
batants  with 

UCAVs 

Poll  all  combatants  with 
UCAVs  periodically  and 
designate  one  as  the 
“duty"  launcher 

Moderate  cost  in 
collaboration  time 

Possibly  greatest  fly-out  time 
for  the  UCAV  after  decision  is 
taken 

NOTE:  In  this  context,  "polling”  is  a  request  from  a  central  authority  for  information 
essential  to  selecting  one  of  the  candidate  ships  with  UCAVs  to  execute  the  TCT 
mission.  Polling  may  or  may  not  be  automated. 


the  ship  deemed  most  suitable  executes  unless  vetoed  by  the  JTFC. 
These  procedures  are  also  candidates  for  further  analysis  using  the 
measures  and  metrics  proposed  below. 


LATENCIES 

For  each  of  the  three  cases  studied,  the  time  required  to  perform  the 
required  tasks  is  central  to  computing  the  latency  MOP  necessary  to 
evaluate  the  effectiveness  of  TCT  operations.  Table  4.2  lists  the  ex¬ 
pected  (mean)  times  required  to  complete  the  tasks  listed  along  with 
a  reasonable  upper  bound  (the  lower  bound  is,  of  course,  0).  All 
times  are  stated  in  minutes  and  are  converted  to  hours  in  the  spread¬ 
sheet  model  presented  in  Chapter  Five. 
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Table  4.2 

Expected  and  Maximum  Latencies 


Options 

Platform-Centric 

Network-Centric 

Future  Network- 
Centric 

Tasks 

Mean 

Maximum 

Mean 

Maximum 

Mean 

Maximum 

ISR  SSN  alert 
SubGroup  pro- 

15 

60 

15 

60 

15 

60 

cessing 

CV reads,  pro¬ 
cesses,  derts 

20 

45 

20 

45 

20 

45 

flight  operations 

10 

20 

5 

10 

__ 

CV  directs  aircraft 
Select  launch 

2 

5 

— 

— 

— 

— 

platform 

Aircraft  prepara- 

— 

— 

— 

— 

2 

5 

tion  and  launch 

5 

10 

5 

10 

_ 

UCAV  launch 

— 

— 

_ 

5 

10 

UCAV  fly-out 

_ 

— 

— 

_ 

5 

10 

F/A- 18  fly-out 

15 

30 

15 

30 

_ 

SLAM-ER  fly-out 

15 

20 

15 

20 

15 

20 

SSN  update 

15 

60 

15 

60 

15 

60 

NOTE:  All  times  are  in  minutes. 


Platform-Centric  Latencies 

Communications  latencies  begin  with  an  alert  that  the  Kilo  has  left 
port.  Security  concerns  prevent  the  ISR  SSN  from  communicating 
this  data  immediately.  The  expected  alert  latency  is  estimated  to  be 
15  minutes  for  the  purpose  of  this  study  and  60  minutes  at  most. 
Note  that  latencies  apply  only  to  the  initial  alert  notice.  The  ISR  SSN 
will  be  unable  to  update  the  Kilo’s  position,  course,  and  speed  con¬ 
tinuously  (giving  one  update  on  average  every  15  minutes  and  at 
worst  every  hour).®  Data  will  be  current  at  time  of  transmission. 

Using  procedures  in  effect  in  the  1980s,  the  mean  time  for  a  subma¬ 
rine  group  to  receive,  digest,  and  retransmit  the  information  from 
the  ISR  SSN  is  20  minutes  with  a  maximum  time  of  45  minutes. 


®These  time  estimates,  and  all  others  in  this  vignette,  are  based  on  discussions  with 
the  former  commanding  officer  of  an  SSN  that  conducted  a  similar  ISR  mission. 
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At  the  carrier,  the  information  from  the  submarine  group  is  read  at 
the  Carrier  Intelligence  Center  (CVIC)  and  extracted  to  reduce  classi¬ 
fication  level.  The  information  is  then  conveyed  to  air  operations. 
The  mean  time  for  this  manual  process  is  estimated  to  be  10  minutes 
with  a  maximum  of  20  minutes. 

The  update  information  is  then  communicated  to  the  F/A-18  with  a 
short  delay  (estimated  at  two  minutes  on  average  with  a  maximum  of 
five  minutes). 

Total  latency  in  alerting  the  carriers  is  estimated  to  be  35  minutes  on 
average  with  a  maximum  of  105  minutes.  Updates  to  the  aircraft  are 
estimated  to  be  just  over  half  an  hour  on  average  (32  minutes)  with  a 
maximum  of  70  minutes.  This  means  that,  on  average,  the  F/A-18 
will  have  half-hour- old  targeting  data  at  the  time  of  attack.  The  tar¬ 
get  area  of  uncertainty  is  about  20  square  nautical  miles  for  this  type 
of  operation. 

In  terms  of  operational  delays,  there  will  be  a  delay  from  the  time  air 
operations  receives  the  alert  to  F/A-18  launch  time.  This  is  taken  to 
be  five  minutes  on  average  and  10  minutes  at  most  (the  F/A-18  was 
kept  in  Alert  5  status).  It  must  fly  out  (taken  to  be  15  minutes  on  av¬ 
erage  and  30  minutes  at  most)  to  its  launch  point,  with  expected 
SLAM-ER  fly-out  estimated  also  at  15  minutes  with  a  maximum  time 
of  20  minutes.  It  must  be  launched  outside  the  SAM  envelope  but 
within  150  nautical  miles  of  the  target. 

Several  of  these  latencies  will  apply  in  the  next  two  cases  as  well  and 
therefore  they  will  not  be  repeated. 

Network-Centric  Latencies 

The  time  lapse  from  detecting  Kilo  egress  from  port  to  the  alert  no¬ 
tice  is  unchanged.  It  is  still  driven  by  the  ISR  submarine's  security 
concerns.  However,  the  alert  notice  and  subsequent  updates  are 
now  delivered  directly  to  the  CVIC.  Those  updates  will  then  be  con¬ 
veyed  to  air  operations  within  the  carrier. 

In  terms  of  operational  delays,  there  is  no  difference  from  the  previ¬ 
ous  case.  It  will  still  take  five  minutes  to  launch  the  Alert  5  aircraft  on 
average,  and  so  on. 
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Future  Network-Centric  Latencies 

In  this  case,  using  the  UCAV,  the  alert  messages  go  out  to  the  sub¬ 
marine  group  and  to  the  carriers  as  before.  However,  a  request  for  a 
UCAV  is  sent  at  the  same  time  to  surface  combatants  with  UCAVs  in 
the  area  of  operations.  The  UCAV  ships  negotiate  to  determine 
which  can  get  a  UCAV  to  the  Kilo  first,  and  that  ship  launches  a 
UCAV.  Control  of  the  UCAV  is  transferred  to  the  ISR  submarine. 

The  distinctive  feature  of  this  case  is  that,  whereas  an  Alert  5  aircraft 
can  be  readied  days  in  advance,  the  decision  to  designate  a  surface 
ship  to  launch  the  UCAV  is  conducted  in  real  time.  This  is  because, 
as  ships  move  about  and  ship  status  changes,  the  best  ship  for 
launching  a  UCAV  can  change  dynamically. 

In  this  vignette,  it  is  apparent  that  a  UCAV  can  reach  a  weapon 
launch  point  before  an  F/A-18  could — it  has  a  significantly  shorter 
flight  distance.  This  is  represented  by  an  average  five-minute  and 
maximum  10-minute  fly-out  time  for  the  UCAV  as  opposed  to  an  av¬ 
erage  of  15  minutes  and  a  maximum  of  30  minutes  of  fly-out  time  for 
the  F/A-18.  Offsetting  this  potential  advantage  is  the  additional  de¬ 
lay  imposed  while  the  UCAV  ships  negotiate  to  determine  the  best 
launch  platform  (not  represented  explicitly  in  Figure  4.5).  It  is  con¬ 
ceivable  that,  with  enough  ships  in  the  network,  flight  time  reduction 
would  be  more  than  offset  by  the  additional  time  required  to  select  a 
launch  platform. 


A  PROBABILITY  MODEL  OF  KNOWLEDGE 

The  uncertainties  in  the  TCT  problem  center  on  the  time  required  to 
get  ordnance  on  target.  The  intermediate  times  used  to  collect,  pro¬ 
cess,  and  disseminate  information,  all  of  which  are  also  uncertain, 
contribute  to  this  time.  Because  they  are  uncertain,  all  are  consid¬ 
ered  to  be  random  variables.  They  all  have  the  same  characteristics 
in  that  the  likelihood  that  the  task  will  be  completed  increases  with 
time.  This  behavior  can  best  be  described  with  a  Gamma  distribu¬ 
tion,  r(a,X,).  For  this  work,  we  chose  the  exponential  distribution, 
the  special  case  of  the  Gamma  where  ot  =  1.  This  is  made  more  ex¬ 
plicit  later.  For  now,  we  consider  the  time,  t,  required  to  complete 
one  of  the  tasks  in  the  TCT  problem,  where  t  is  a  random  variable 
with  density  function: 
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fCt)  =  Xe~^^  foTt>0. 

The  expected  (mean)  time  required  to  complete  the  task  is  1/  ^ 
minutes/  The  uncertainty  in  this  and  the  other  times  constituting 
the  overall  TCT  problem  can  be  taken  to  reflect  a  lack  of  knowledge. 
Knowing  exactly  how  long  each  task  takes  facilitates  planning  and 
execution — a  lack  of  knowledge  can  result  in  poor  planning  and 
mission  failure.  Consequently,  it  is  important  to  quantitatively  as¬ 
sess  the  knowledge  possessed  by  the  decisionmaker  at  the  time  a 
decision  must  be  taken.  As  in  the  missile  defense  vignette  discussed 
in  Chapter  Three,  we  turn  to  the  field  of  information  theory  and  the 
concept  of  information  entropy  or  the  average  information  in  a  prob¬ 
ability  distribution  to  characterize  knowledge. 

Information  Entropy 

Recall  from  Chapter  Three  that  information  entropy  (or  Shannon 
entropy)  is  a  measure  of  the  average  amount  of  information  in  a 
probability  distribution  and  is  defined  as: 


H{t)  =  -\  \n[f{t)]fit)dt. 
Jt=o 


Applying  this  to  the  exponential  distribution  we  get: 


This  suggests  the  following  definition  for  the  knowledge  associated 
with  the  latency  distribution: 


Kit)  = 


0 


if  ^ 


1 


mm  • 


if  ^min  -  ^^min 


^The  inverse,  X ,  is  therefore  the  number  of  these  tasks  that  can  be  accomplished  in  a 
unit  time  (minute). 

complete  derivation  of  this  term  can  be  found  in  Chapter  Three. 
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One  problem  with  this  formulation  is  the  condition  for  “perfect” 
knowledge.  This  occurs  when  K{t)  =  1  or  when  the  expected  time  to 
complete  a  task,  1/X,  is  approximately  one-third  the  maximum  ex¬ 
pected  time  to  complete  the  task.  It  may  be  desirable  in  some  cases 
to  employ  more  stringent  conditions  on  “perfect”  knowledge.  This 
can  be  accomplished  by  casting  the  probability  distribution  in  terms 
of  M  >  e.  Although  the  distribution  would  not  be  exactly  the  form  of 
the  exponential  with  e  as  the  base,  it  will  have  a  similar  form  and  the 
condition  for  “perfect”  knowledge  will  be  more  stringent.  Figure  4.6 
illustrates  the  knowledge  function  for  =0.5  completions  per 
hour,  or  a  maximum  time  of  two  hours  to  complete  a  task. 

MOP 

We  start  by  assessing  the  performance  of  the  command  and  control 
system  in  both  a  platform-centric  and  network-centric  environment. 


Figure  4.6 — ^The  Knowledge  Function 
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The  MOP  is  time-on-target.  This  is  defined  as  the  time  elapsed  from 
the  moment  the  target  becomes  vulnerable  or  can  be  engaged  to  the 
time  it  is  no  longer  vulnerable  or  cannot  be  engaged.  In  our 
example,  this  is  the  time  available  for  the  aircraft  (or  U04V)  to  fly  out 
to  the  AOU,  and  detect,  target,  and  kill  the  enemy  submarine  before 
it  submerges.  Minimizing  this  accumulated  time  increases  the  likeli¬ 
hood  that  the  mission  can  be  accomplished  before  the  submarine 
submerges  and  is  therefore  an  appropriate  measure  of  system  per¬ 
formance. 

Instead  of  treating  the  time  the  Kilo  submerges  as  a  random  variable 
and  thus  introduce  additional  uncertainty,  we  instead  treat  it  para¬ 
metrically.  In  addition,  we  assume  that  no  uncertainty  exists  about 
the  location  of  the  target  in  that  the  Virginia-claiss  SSN  is  tracking  the 
Kilo. 

Determining  time- on- target  seems  rather  simple — i.e.,  just  subtract 
the  latency  from  onset  of  target  vulnerability  to  time  of  engagement 
from  the  total  time  of  vulnerability.  However,  subtleties  must  be 
considered. 

The  Operational  Network  as  a  Graph 

We  begin  by  describing  the  command,  control,  and  communications 
network  supporting  the  operation  as  an  abstraction  of  a  directed 
graph.  A  graph,  G(X,  E),  is  composed  of  a  set  of  nodes,  X  = 
{xi,X2,...,x„},  and  a  collection  of  edges,  E  =  Joining  all 

or  some  of  the  nodes.  Suppose  we  have  a  notional  network  that 
consists  of  n  nodes  with  m  edges.  Framing  the  discussion  in  terms  of 
a  command  and  control  system,  we  refer  to  the  edges  as  connections 
and  we  refer  to  the  graph  as  the  network.  By  “connection,”  we  mean 
that  the  “connected”  nodes  are  able  to  communicate  to  each  other 
directly.  This  does  not  necessarily  mean  that  there  is  a  physical  con¬ 
nection  between  the  two.  Each  connection  may  have  a  component 
that  indicates  the  direction  in  which  the  communication  of  informa¬ 
tion  may  flow  between  nodes.  Connections  where  the  communica¬ 
tions  flow  is  unidirectional  are  called  directed  connections.  In  Figure 
4.7,  the  communication  between  nodes  6  and  8  is  two-way,  but  the 
flow  of  information  between  nodes  8  and  9  is  directional  (node  8  may 
pass  information  to  node  9  but  may  not  receive  information  directly 
from  node  9).  If  at  least  one  connection  in  the  network  G(X,  E)  is 
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directed,  we  refer  to  the  network  as  a  directed  network.  If  no  con¬ 
nection  is  directional,  the  network  is  nondirected.  When  a  network  is 
directed,  we  refer  to  the  transmitting  node  as  the  initial  node  and  the 
receiving  node  as  the  terminal  node. 

Of  the  n  nodes  in  the  network,  however,  only  x  are  involved  in  the 
current  operation.  The  shaded  nodes  represent  those  involved  in  the 
operation.  This  is  typically  the  structure  of  operational  networks. 
Not  all  potential  operational  elements  are  connected  and  not  all  are 
involved  in  the  current  operation.  For  example.  Figure  4.7  illustrates 
a  network  with  10  nodes  but  only  three  are  participating  in  the 
current  operation.  There  are  15  connections  (11  with  a  single  com- 
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Participation  in  current  operation 


Figure  4.7 — Notional  Operating  Network 
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munications  direction  and  two  that  are  bi-directional:  11  -j-  (2  x  2)  = 
15)  in  the  total  network  but  only  three  connections  (one  one-way  and 
one  two-way  =  1  -i-  (1  x  2)  =  3)  between  nodes  participating  in  the  cur¬ 
rent  operation. 

Some  interesting  relationships  arise  from  this  topology  however. 
First,  we  note  that  the  maximum  number  of  connections  in  an 
undirected  network  with  n  nodes  is: 

(n\  n{n-l) 

In  this  case,  we  have  that  m  <  [n{n  - 1)]  12.  In  a  directed  network  with 
n  nodes,  the  maximum  number  of  connections  is  n{n  - 1)  so  that  m  < 
nin  -  1).  If  all  the  nodes  in  a  graph  are  connected,  the  graph  is  re¬ 
ferred  to  as  being  complete.  In  the  directed  network  in  Figure  4.7,  we 
have  a  maximum  90  possible  connections. 

Second,  it  is  important  to  analyze  the  role  of  connected  facilities  not 
directly  involved  in  the  operation.  For  example,  nodes  6  and  8  are 
connected  to  node  7.  If  node  7  were  the  CJTF  controlling  the  opera¬ 
tion,  then  6  and  8  might  be  information  sources  (fusion  centers  on 
board  or  remotely  located,  national  intelligence  centers,  etc.)  avail¬ 
able  to  the  CJTF.  These  connections  allow  the  participants  to  collab¬ 
orate  in  arriving  at  a  decision.  We  expect  that  collaboration  in  this 
case  improves  the  quality  (accuracy,  timeliness,  and  completeness) 
of  the  decision  and  is  therefore  an  attribute  of  the  command,  control, 
and  communications  process  that  needs  to  be  factored  into  the 
overall  metric. 

The  rfi  Phenomena 

More  important  than  counting  the  number  of  connections  of  one 
type  or  another  is  the  value  of  the  connections — i.e.,  their  contribu¬ 
tion  to  combat  outcome.  If  we  examine  the  complete  directed  graph, 
we  see  that  there  are  n{n  -  1)  =  -  n  connections.  If  we  assume 

that  all  connections  contribute  to  the  value  of  the  network,  then 
more  connections  are  desirable.  Logically,  we  conclude  that  for  a 
very  large  n,  the  first  term,  dominates  and  therefore  the  value  of 
the  network  increases  as  the  square  of  the  number  of  nodes  in  the 
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network  increases.  This  is  referred  to  as  Metcalfs  Law,  named  for 
Robert  Metcalf,  a  pioneer  in  the  development  of  the  Ethernet.  ^ 

The  problem  with  this  assessment  of  a  network’s  value  is  that  it  as¬ 
sumes  that  all  interactions  are  equally  'Valuable”— that  is,  that  they 
all  contribute  an  equal  positive  amount  to  the  value  of  the  network. 
This  is  clearly  not  always  the  case.  The  problem  of  assessing  the  true 
value  of  the  network  in  terms  of  its  contribution  to  combat  outcomes 
is  much  more  complex. 

Too  Much  Information 

Another  “law”  governing  connected  networks  deals  with  the 
propensity  of  people  to  utilize  available  connections  to  transmit  in¬ 
formation  that  may  or  may  not  be  useful  to  the  recipient.  Simply 
stated,  the  larger  the  number  of  connections  in  an  operational  net¬ 
work,  the  more  likely  individual  nodes  will  experience  "information 
overload.”  This  is  simply  a  paraphrased  Parkinson’s  Law  that  “work 
expands  to  fill  the  time  available.”  That  is,  if  a  communication  chan¬ 
nel  exists  it  is  likely  to  be  used.  This  too  is  compelling — however,  like 
Metcalfs  Law  it  does  not  apply  universally.  With  proper  filtering, 
extraneous  communications  can  be  controlled,  especially  during 
critical  operations,  However,  anecdotal  evidence  seems  to  confirm 
that  instances  of  "information  overload”  occur  over  undisciplined 
networks. 

Latency 

Although  not  the  complete  story,  the  time  required  to  get  a  weapon 
on  target  is  an  important  part  of  the  time -on- target  metric.  In  gen¬ 
eral,  T  <  n  nodes  are  involved  in  the  operation.  We  will  refer  to  these 


Robert  Metcalf  is  credited  with  discovering  the  Ethernet.  He  was  also  founder  of  the 
3Com  Corporation  of  Santa  Clara,  California,  in  1981,  the  leading  producer  of  Ethernet 
adapter  cards.  An  interesting  discussion  of  Metcalf  and  his  "law  of  the  telecosm”  can 
be  found  in  Gilder  (1993).  See  also  Appendix  A  to  Alberts,  Gartska,  and  Stein  (1999). 

^^The  actual  quote  is:  "Data  expands  to  fill  the  space  available  for  storage,"  Buying 
more  memory  encourages  the  use  of  more  memory- intensive  techniques.  Those  of  us 
who  use  computers  have  experienced  the  wisdom  of  these  words.  See,  for  example 
Parkinson  (1957). 
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nodes  as  the  task  force. Not  all  need  be  combat  elements;  some 
may  be  sensors,  information  processing  facilities,  etc.  The  only  cri¬ 
terion  is  that  they  be  directly  involved  in  the  mission.  The  time  re¬ 
quired  for  each  to  perform  its  assigned  tasks  contributes  directly  to 
latency.  Note  that  we  are  not  concerned  about  '‘how  well”  they  per¬ 
form  their  task  at  this  point— just  how  long  it  takes.  It  is  also  possible 
that  the  elements  of  the  task  force  perform  their  tasks  in  parallel,  se¬ 
quentially,  or  some  combination  of  both. 

For  node  i,  the  time,  t,  required  to  perform  all  of  its  tasks  in  support 
of  the  operation  is  taken  to  be  a  random  variable  with  exponential 
distribution: 


where  l/Xf  is  the  mean  time  to  complete  all  tasks  at  node  i.  Assum¬ 
ing  that  all  nodes  act  sequentially,  we  then  get  a  total  expected  la¬ 
tency  of 


^=I 


T  1 


Other  operating  concepts  are  possible.  For  example,  Figure  4.8  de¬ 
picts  two  different  concepts,  both  of  which  have  sequential  and  par¬ 
allel  processing  components.  The  expected  latency  for  the  first  con¬ 
cept  is; 


graph-theoretic  terms,  this  is  called  a  subgraph,  G5(X,E),  that  contains  only  a 
subset  of  the  nodes  in  X,  but  contains  all  of  the  edges  whose  initial  and  terminal  nodes 
are  within  the  subset.  Applied  to  command  and  control,  a  subgraph  is  a  subnetwork. 
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Figure  4.8 — ^Alternative  Operating  Concepts 


Note  that  only  the  path  nodes  are  assessed,  not  the  transit  time  be¬ 
tween  the  nodes.  The  reason  is  that  we  are  assessing  the  delay  at  the 
nodes  only:  The  communication  time  between  nodes  is  taken  to  be 
practically  instantaneous. 

In  either  case,  the  critical  path  times  constitute  the  expected  latency. 
If  we  let  p  <  X  represent  the  number  of  nodes  on  the  critical  path,  the 
expected  latency  then  is: 
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where 


_  I  lif  node /is  on  the  critical  path  y«t  ^  _ 

^  jo  otherwise  ’  ^  ^ 

Also  observe  that  if  the  effective  times  required  for  critical  path 
nodes  to  complete  their  tasks  are  sufficiently  reduced,  a  new  critical 
path  may  emerge. 

Information  Quality 

In  our  example,  the  quality  of  the  information  about  the  location  of 
the  enemy  submarine  is  influenced  in  several  ways  by  the  command, 
control,  and  communications  system.  First,  the  equipment  and  pro¬ 
cedures  in  place  at  each  of  the  nodes  that  contribute  to  the  operation 
affect  the  accuracy  of  the  intermediate  products  produced  at  that 
node.  For  example,  the  fusion  facilities  on  board  the  cuing  system 
determine,  in  part,  how  well  the  enemy  submarine  is  tracked.  Sec¬ 
ond,  the  degree  to  which  the  task  force  is  able  to  collaborate  to  in¬ 
form  decisions  and  ensure  that  a  complete  picture  is  at  hand 
increases  the  confidence  that  a  correct  (accurate)  decision  will  be 
taken.  Third,  the  ability  of  the  task  force  to  access  other  nodes  in  the 
network  to  complete  the  operational  picture  helps  ensure  nothing  is 
missed.  Finally,  the  amount  of  training  and  level  of  experience  of  the 
crews  and  the  length  of  time  they  have  operated  as  a  team  affect  the 
speed  with  which  they  are  able  to  accomplish  their  assigned  task — to 
locate  and  engage  the  enemy  submarine. 

A  comprehensive  measure  of  quality  therefore  would  include  ele¬ 
ments  of  accuracy,  completeness,  and  timeliness.  A  validation  and 
calibration  process  would  include  adequate  representations  of  each. 
However,  for  this  work,  a  suitable  measure  of  quality  was  taken  to  be 
the  amount  of  knowledge  available  about  the  expected  times  re¬ 
quired  to  complete  tasks.  The  quality  of  the  processes  and  equip¬ 
ment  in  place  at  each  node,  /,  in  the  task  force  is  calculated  as  the 
knowledge  function,  and  therefore  we  have  a  metric,  0  <  <  1.  A 
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value  of  Kiit)  close  to  1.0  implies  high  quality,  whereas  one  nearer  to 
0  implies  low  quality.  In  addition  to  the  nodes  in  the  task  force,  we 
assume  that  the  quality  of  the  products  produced  by  other  nodes  in 
the  network  can  also  be  measured  in  the  same  way. 

Collaboration’s  Effect 

In  Chapter  Three,  collaboration  was  defined  as  a  process  in  which  a 
team  of  individuals  works  together  to  achieve  a  common  goal.  It  was 
argued  that  collaboration  enhances  the  degree  of  shared  awareness 
in  a  group  focused  on  solving  a  specific  problem  or  arriving  at  an 
agreed-on  decision.  In  the  TCT  problem,  collaboration  consists  of 
sharing  information,  among  the  task  force  members  and  others  in 
the  network,  needed  to  accomplish  the  mission  of  locating  and  en¬ 
gaging  the  enemy  submarine.  In  general,  therefore,  collaboration 
can  contribute  to  the  network’s  ability  to  support  combat  operations. 

Before  we  assess  the  contribution  of  collaboration  to  the  task  of  lo¬ 
cating  and  engaging  the  enemy  submarine,  we  need  to  expand  our 
discussion  of  graph  theory  to  include  the  definition  of  the  indegree  of 
a  node: 

Indegree:  The  indegree  of  a  node,  Xj  ,  in  a  directed  graph  is  the 
number  of  edges  that  have  jc^  as  their  terminal  node. 

The  network  graphs  in  Figures  4.7  and  4.8  are  directed  graphs.  Note 
that  node  6  in  Figure  4.7,  for  example,  has  indegree  4. 

The  opportunity  for  collaboration  depends  on  the  number  of  task 
force  and  other  nodes  each  task  force  node  is  connected  to,  or  the 
indegree  of  the  node. 

The  quality  of  collaboration  as  represented  by  the  collective  knowl¬ 
edge  of  the  collaboration  team  has  the  effect  of  reducing  the  amount 
of  time  required  to  complete  the  task  (take  a  decision,  order  its  exe¬ 
cution,  and  take  the  action  required).  This  is  an  important  point  be¬ 
cause  it  may  be  the  source  of  confusion  here  and  later  in  the  text.  By 
“effectively"  reducing  the  time  required,  we  recognize  that  although 
quality  collaboration  may  in  fact  have  no  effect  on  the  “actual"  time 


l^Taken  from  Christofides  (1975).  See  also  Jackson  and  Thoro  (1990). 
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required  to  complete  the  task,  it  does  provide  the  opportunity  to  use 
the  time  available  more  wisely  and  therefore  makes  an  improvement 
in  the  quality  of  the  eventual  outcome  of  the  operation  more  likely. 
An  advantage  of  this  approach  is  that  it  can  be  used  to  express  the 
quality  of  collaboration  in  terms  meaningful  to  operators  by  translat¬ 
ing  it  into  additional  time  to  perform  a  task  or  mission. 

We  should  also  add  here  that  clearly  other  factors  could  be  taken  into 
account  besides  the  amount  of  time  required  to  complete  tasks. 
Each  node  may  contribute  something  unique  to  the  process,  and  its 
ability  to  do  so  may  be  uncertain.  This  gives  rise  to  the  possibility 
that  several  random  variables,  some  dependent  and  others  indepen¬ 
dent,  are  in  play  at  each  node.  Combining  these  uncertainties  to 
form  a  comprehensive  knowledge  function  is  the  subject  of  future  re¬ 
search. 

For  a  directed  connection,  if  the  quality  of  the  interaction  between 
the  terminal  task  force  node,  z,  and  any  other  connected  initial  node, 
j,  is  “good,"  then  Kj  (t)  will  be  close  to  1.  This  represents  the  fact  that 
node  j  is  able  to  supply  quality  information  to  the  executing  node.  If 
Kj  it)  is  large,  then  1  -  Kj  (t)  <  1  will  be  small  and  when  multiplied 
with  the  actual  mean  time  to  complete  the  task,  1/  A./,  will  produce 
an  effective  latency  smaller  than  the  actual  latency,  1  / . 

If  we  let  di  be  the  indegree  of  the  task  force  node  z,  then  the  contri¬ 
bution  of  quality  collaboration  to  node  z’s  operation  can  be  ex¬ 
pressed  as  the  product: 


_ J  (0  / 


where 


C0y  = 


0.5  if  node  j  is  not  in  the  task  force 
1.0  if  node  j  is  in  the  task  force 


The  exponent,  coy,  accounts  for  the  relative  importance  of  the  col¬ 
laboration  between  two  nodes.  In  this  case,  in  the  absence  of  any 
experimental  data,  we  use  only  two  levels:  important  (0.5)  and  very 
important  (1.0).  Perhaps  a  richer  distribution  would  more  accurately 
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reflect  the  nuances  in  the  effectiveness  of  the  collaboration  and  its 
effect  on  latency,  but  that  remains  for  further  analysis  through  exper¬ 
imentation. 

The  total  effective  latency  accounting  for  collaboration  is  therefore: 


The  effect  of  collaboration  is  to  reduce  the  total  expected  time  re¬ 
quired  to  complete  the  mission,  and  “good”  collaboration  reduces  it 

further. 


Complexity 

The  concept  of  network  complexity  was  introduced  in  Chapter 
Three,  where  we  deferred  the  detailed  discussion  of  the  subject  to 
this  chapter,  where  its  application  is  easier  to  assess. 

Acting  counter  to  Metcalfs  Law,  we  have  noted  that  in  a  well- 
connected  network  (however  large)  the  possibility  always  exists  that 
too  much  information  is  made  available  to  the  task  force  nodes,  re¬ 
sulting  in  what  is  generally  referred  to  as  “information  overload.” 
This  can  have  the  opposite  effect  of  collaboration.  Instead  of  effec¬ 
tively  cutting  the  time  required  to  complete  tasks,  it  can  prolong  the 
time  as  staff  and  commanders  sift  through  the  information  for  what 
is  required.  On  the  other  hand,  a  richly  connected  network  with  a 
well-disciplined  command  and  control  system  installed  can  facilitate 
decentralized  decisionmaking  and  execution  and  therefore  improve 
the  effectiveness  of  combat  operations  as  well  as  reduce  the  time 
needed  to  process  information. 

Network  complexity  therefore  can  have  both  good  and  bad  effects. 
In  this  work,  we  assess  the  benefits  of  complexity  in  terms  of  collabo¬ 
ration  effects  and  the  negative  effects  of  information  overload  as  a 
factor  that  increases  the  time  required  to  perform  necessary  tasks.  It 


^^Note  that  if  one  of  the  quality  metric  values  for  a  node  collaborating  with  a  task  force 
node  is  1.0,  the  time  required  for  the  task  force  node  to  complete  its  task  is  0. 
However,  the  method  of  calculating  the  quality  metric  prevents  this  from  happening. 
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should  be  noted,  however,  that  we  can  mute  the  negative  effects  by 
suitable  selection  of  parameters  in  the  complexity  metric. 

Complexity  then  is  a  function  of  the  total  number  of  connections  to 
the  task  force  nodes,  or  the  total  indegree  of  the  operation.  There¬ 
fore,  complexity  focuses  on  the  potential  misuse  of  the  network, 
whereas  collaboration  focuses  on  the  effective  use  of  the  network.  If 
we  let  C  represent  the  total  number  of  connections  in  the  network, 
then 


For  small  values  of  C,  the  complexity  effect  is  negligible,  and  for  some 
range  it  increases  rapidly,  leveling  off  at  what  might  be  referred  to  as 
the  information  overload  point— i.e.,  when  the  information  arriving 
from  the  multiple  connections  is  so  great  as  to  practically  shut  down 
operations.  Although  the  exact  functional  relation  is  not  known,  a 
logistic  or  S-curve  relation  between  Cand  the  complexity  factor  ex¬ 
hibits  the  appropriate  behavior. if  we  let  g(Q  represent  the  com¬ 
plexity  factor,  we  have: 


giC)  = 


^a+bC 


The  parameters  a  and  b  determine  both  the  region  of  minimal  im¬ 
pact  and  the  size  of  the  region  of  rapidly  increasing  impact.  Figure 
4.9  illustrates  a  typical  complexity  function  for  the  0  to  90  possible 
connections  for  the  network  depicted  in  Figure  4.7.^^ 

Including  complexity  in  the  calculation  of  expected  latency,  we  get: 


4c  - 


1 


l-giC) 


h. 

jh 


(1) 


^^The  actual  relationship  should  be  established  through  experimentation. 

^^Assuming  the  logistic  curve  is  the  appropriate  model  for  the  complexity  factor,  se¬ 
lecting  the  coefficients  is  problematic.  They  are  clearly  application-specific  and  there¬ 
fore  best  derived  from  experimentation.  Those  depicted  in  this  report  are  notional. 
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Figure  4.9 — Complexity  Factor 


When  the  number  of  connections  is  low,  the  complexity  effect  on  la¬ 
tency  is  minimal.  Between  about  30  and  60  connections,  the  com¬ 
plexity  effect  rises  sharply,  leveling  off  to  near  paralysis  at  90. 

Effective  Expected  Latency 

Equation  (1)  reflects  the  balance  between  the  positive  effects  of  col¬ 
laboration  and  the  negative  effects  of  complexity.  If  the  effects  of 
complexity  are  negligible — i.e.,  there  are  few  connections  in  the  net¬ 
work — and  the  effects  of  collaboration  are  considerable — i.e.,  the 
knowledge  function  for  most  distributions  is  high— then  it  is  possible 
for  the  expected  latency  to  be  much  lower  than  the  sum  of  the  critical 
path  latencies.  This  means  that  the  positive  effects  of  collaboration 
have  compensated  for  the  time  required  to  perform  all  operational 
tasks.  The  converse  is  also  true  in  a  richly  connected  network  where 
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the  knowledge  functions  are  rather  small.  That  is,  the  effective 
latency  can  exceed  the  critical  path  latency.  For  this  reason,  we  refer 
to  Lcc  as  the  “effective  expected  latency." 

MOE 

The  measure  of  TCT  effectiveness  used  here  is  simply  the  probability 
that  the  target  can  be  attacked  during  the  window  of  opportunity. 
For  the  case  of  the  surfaced  threat  submarine,  it  is  the  probability 
that  the  aircraft  can  detect,  classify,  and  place  ordnance  on  the  sub¬ 
marine  before  it  submerges.  This  probability  of  detection  depends 
on  time  on  target,  the  quality  (accuracy,  timeliness,  and  frequency) 
of  the  location  and  speed  estimates  of  the  enemy  submarine,  and  the 
characteristics  of  the  attack  weapon.  For  the  purpose  of  illustration, 
we  assume  that  the  aircraft  will  attack  using  a  missile  with  an  electro- 
optical  system  that  can  detect  and  classify  the  threat  submarine  on 
the  surface.  The  aircraft  is  not  expected  to  detect  the  submarine 
directly.  The  pilot  will  use  the  cockpit  display  from  the  missile  to 
detect  and  classify  the  target.  The  pilot  will  then  lock  the  missile 
onto  the  target.  For  simplicity,  we  regard  the  aircraft  as  searching  the 
AOU  about  the  target  submarine,  with  the  missile  used  as  a  remote 
sensor.  We  assume  a  sea-skimming  missile  with  an  accordingly 
short  acquisition  range,  and  that  once  the  missile  has  acquired  the 
submarine  it  will  be  killed  quickly.  In  other  words,  we  ignore  time  of 
flight  over  the  acquisition  range  and  weapon  reliability. 

Detection  and  Target  Acquisition 

If  S  is  the  time  elapsed  between  the  moment  the  submarine  leaves 
port  and  submerges  (in  hours),  then  T  =  S  -  where  T  is  the  ef¬ 
fective  search  time.  If  T<  0,  the  aircraft  fails  to  engage  the  target.  If 
r>  0,  the  cumulative  probability  that  the  aircraft  detects  and 
acquires  the  target  depends  on  the  time  it  must  search  the  AOU.^® 

If  we  let  q(T)  =  I-  P^(r),  where  P^iT]  is  the  probability  of  detection 
as  a  function  of  search  time,  then  ^^(Tl  is  the  probability  that  there 


^®For  purposes  of  this  analysis,  we  are  concerned  with  both  detection  and  acquisition. 
However,  for  ease  of  exposition  in  the  sequel,  we  refer  to  both  as  simply  "detection.” 
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will  be  no  detections  over  the  same  time.  For  there  to  be  no  detec¬ 
tion  at  time  T  +  dT,  there  must  be  no  detection  up  to  time  Tand  there 
must  be  no  detection  in  the  time  interval  The  instanta¬ 

neous  probability  of  detection  or  nondetection  depends  on  search 
sweep  width  and  search  speed  as  illustrated  in  Figure  4.10.  It  is  time 
invariant.  The  failure  to  detect  by  time  T  is  independent  of  the 
failure  to  detect  by  T  +  dT.  If  we  let  s  denote  the  sweep  width  in 
nautical  miles,  v  denote  missile  speed  in  knots,  and  A  the  AOU  in 
square  nautical  miles,  the  probability  of  detection  in  the  time  in¬ 
terval  [T,  T  +  dl]  is  svdTIA  and  the  probability  no  detection  takes 
place  is  1  -  svdTIA.  For  convenience,  we  let  %  =  svIA,  so  that  the 
probability  that  no  detection  takes  place  by  time  T+  dTis  q{T+  dT)  = 
qiT){l-  Xdl)  =  q{7)  -q{T)XdT.  Rearranging,  we  get: 


q{T^dT)-q{T) 

dT 


=  -qiT)y. 


In  the  limit  as  dT  0,  we  get: 


dq{T) 

dT 


-yq[T). 


The  solution  to  this  differential  equation  \s  q{T)~  a e~^'^  for  an  ar¬ 
bitrary  constant  a.  Because  it  is  certain  that  with  no  time  devoted  to 
searching  there  will  be  no  detection,  we  have  the  boundary  condition 
qm  =  1;  therefore  a  =  0  and  q{T)  =  e~^^ .  The  probability  of  detection 
then  is: 


Prf(7)  =  l-e--Y7'^i8 

As  depicted  in  Figure  4.10,  A  is  a  circular  region.  However,  the  actual 
shape  of  the  region  depends  on  what  the  friendly  force  knows  about 
the  enemy  submarine’s  mission— a  priori  knowledge.  If  the  Kilo  is 
known  to  be  en  route  to  replace  the  destroyed  submarine,  then  the 


^^Because  these  terms  are  based  on  T,  the  “effective”  search  time,  the  probabilities  are 
technically  “effective”  probabilities. 

*®See  Koopman  (1980). 
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friendly  commander  knows  that  the  full  360°  sweep  need  not  be 
searched  in  that  it  is  unlikely  that  the  submarine  will  reverse  direc¬ 
tion  or  veer  radically  off  course.  The  size  of  the  AOU  is  assumed  to 
increase  with  the  square  of  the  time  elapsed  since  the  last  Kilo  posi¬ 
tion  update.  This  assumption  is  consistent  with  a  circular  AOU,  or  a 
“pie  wedge”  AOU  (reflecting  a  priori  knowledge  of  heading  limits),  or 
an  elliptical  AOU  with  fixed  eccentricity  (reflecting  uncertainties  in 
speed  and  heading).  The  effect  of  knowledge  in  this  case  is  to  reduce 
the  size  of  the  AOU  by  restricting  the  search  to  a  fraction  of  the  circle 
coincident  with  the  direction  of  the  submarine. 

The  size  of  the  AOU  depends  on  the  elapsed  time,  t^,  since  the  last 
update  and  on  the  speed  of  the  surfaced  submarine  or: 
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where  0  <  1/  <  1  is  the  fraction  of  the  circle  that  must  be  searched 

based  on  the  prior  knowledge  of  the  submarine’s  route  of  advance. 
For  simplicity,  we  ignore  the  possibility  that  the  AOU  will  grow  dur¬ 
ing  the  search.  Similarly,  we  ignore  the  possibility  of  updating  target 
data  during  the  search.  Now,  the  cumulative  detection  probability 
function  becomes: 


svk^  j 

P^(T)  =  l~e  . 

Although  the  friendly  commander  has  no  control  over  target  speed 
improved  equipment  and  procedures  can  greatly  affect  v,  s,  and  T 
and  good  intelligence  can  affect  ^lk . 

Figure  4.11  illustrates  the  increase  in  detection  probability  for  two 
cases:  when  the  AOU  is  20  square  nautical  miles  and  when  the  AOU 
is  only  one  square  nautical  mile.  In  both  cases,  the  speed  of  the 
missile  is  450  knots  and  the  sweep  width  is  .25  nautical  miles.  If  we 
assume  that  the  speed  of  the  target  submarine  is  constant,  then  the 
radius  of  the  AOU  is  dependent  solely  on  the  time  elapsed  since  the 
last  update  on  the  target  submarine's  location.  Note  the  dramatic 
difference  in  the  results.  For  the  one-square-nautical-mile  case,  de¬ 
tection  probability  reaches  its  maximum  within  two  or  three  minutes 
of  search,  whereas  the  detection  probability  for  the  20-square- 
nautical-mile  case  has  still  not  reached  its  maximum  after  30  min¬ 
utes  of  search. 

Kill  Probability 

The  probability,  is  the  probability  that  the  target  will  be  de¬ 

tected  by  time  T.  This  is  the  cumulative  probability  distribution  for 
the  density  function 


fdiT]  =  ye 


This  function  has  a  mean 
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Figure  4.1 1 — ^AOU  Effects  on  Detection  Probability 
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This  is  the  expected  time  required  to  detect  the  target.  As  with  times 
required  to  collect,  process,  and  disseminate  information,  a  maxi¬ 
mum  expected  time  can  be  determined,  and  therefore  the  knowledge 
resident  in  the  detection  time  density  fd^)  is  assessed  as: 
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This  can  be  used  to  reflect  the  quality  of  the  target  location  estimate 
by  influencing  the  probability  of  detection. 

In  general,  if  KiT)  is  large — that  is,  if  the  uncertainty  concerning  the 
remaining  search  time  is  small — we  would  expect  a  search  more  ef¬ 
fectively  matched  to  the  time  available.  This  also  has  the  effect  of  re¬ 
ducing  the  search  area.  If  the  amount  of  reduction  is  1  -  K{T),  the 
effective  search  area,  ,  becomes: 


=11- . 

Applying  this  to  the  detection  probability  equation,  we  get  the  fol¬ 
lowing  adjusted  detection  probability: 

suk^ 

- r 

If  we  let  be  the  knowledge  enhanced  probability  of  kill,  then  in 
this  case  where  a  detection  is  equivalent  to  a  kill  with  probability  1.0, 
we  get  that  PK\T  =  PdiT). 


SUMMING  UP 

In  this  chapter,  we  have  linked  the  effectiveness  of  the  SLAM-ER 
against  the  enemy  Kilo  to  the  speed  at  which  the  alternative  com¬ 
mand  and  control  systems  and  operational  networks  are  able  to  get  a 
launch  platform  on  station.  To  do  this,  it  was  first  necessary  to  es¬ 
tablish  adequate  measures  of  effectiveness  and  performance.  Next, 
we  developed  mathematical  models  of  collaboration  and  network 
complexity  to  assess  the  performance  of  the  alternative  command 
and  control  procedures. 


The  Measures 

The  paramount  objective  of  the  U.S.  forces  in  the  TCT  vignette  is  to 
keep  the  enemy  Kilo  from  reaching  the  SLOG  north  of  the  island. 
The  JTFC  has  determined  that  catching  it  on  the  surface  and  attack- 
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ing  it  as  early  as  possible  can  best  accomplish  this.  The  decision  to 
dispatch  a  launch  platform  (F/A-18  or  UCAV)  hinges  on  the  JTFC's 
assessment  of  the  time  available  to  him  to  accomplish  his  mission. 
Consequently,  the  command  and  control  MOP  selected  for  this  anal¬ 
ysis  is  time  on  target — i.e.,  the  time  available  to  an  attacking  aircraft 
to  conduct  its  attack  measured  as  the  time  elapsed  between  its  arriv¬ 
ing  on  station  and  the  Kilo  submerging. 

The  combat  MOE  is  the  probability  that  the  aircraft  destroys  the  Kilo 
given  that  it  arrives  on  station  before  the  Kilo  submerges.  Because  of 
the  accuracy  of  the  SLAM-ER  (launched  from  either  the  UCAV  or  the 
F/A-18),  detecting  the  Kilo  is  taken  to  be  equivalent  to  destroying  it. 


The  Metrics 

As  with  the  missile  defense  vignette,  network  complexity  and  collab¬ 
oration  combine  to  affect  combat  operations.  In  this  case,  however, 
the  decision  to  attack  is  based  on  an  assessment  about  the  time  re¬ 
quired  to  get  an  attack  platform  (UCAV  or  F/A-18)  in  position  to 
launch  a  weapon.  The  expected  latency  expression  is: 


4c  = 


i-g(C) 


where  Lcc  represents  the  expected  time  required  to  get  the  attack 
platform  on  station,  given  the  effects  of  collaboration  and  network 
complexity.  Complexity  is  included  in  the  expression  1/  [l-g(Q],  and 
collaboration  is  a  function  of  the  knowledge  factor,  Kj{t) . 

The  effectiveness  of  the  operation  depends  on  the  probability  that 
the  enemy  submarine  will  be  detected  and  successfully  engaged. 
This,  in  turn,  depends  on  the  amount  of  time,  T=S-  available 
to  search  and  attack,  where  5  is  the  time  the  submarine  will  sub¬ 
merge.  We  assume  that  the  SLAM-ER  is  effective  enough  that,  if  de¬ 
tected,  a  target  is  assumed  to  be  destroyed  with  certainty.  The  MOE 
therefore  is  based  on  the  search  equation: 


102  Measures  of  Effectiveness  for  the  Information -Age  Navy 


where  P^iT)  is  the  probability  that  the  submarine  will  be  detected  in 
T  minutes.  The  coefficient  y  consists  of  the  geometrical  aspects  of 
the  problem,  such  as  the  AOU,  the  sensor's  field  of  regard,  and  the 
sweep  width.  In  addition,  it  includes  the  information  update  fre¬ 
quency  from  the  ISR  SSN  and  the  knowledge  gained  from  external 
sources. 


Chapter  Five 

EXPLORATORY  ANALYSIS  TOOL 


Changes  in  MOE  values  that  result  from  modifying  the  levels  of  input 
variables  are  best  understood  by  using  visualization  techniques.  By 
varying  the  input  variables,  we  can  better  understand  the  structure  of 
the  data  and  the  complex  relationships  that  exist  between  the  inputs 
and  the  MOEs.  Such  exploratory  data  analysis  (EDA)  exercises  are, 
unfortunately,  limited  to  a  small  number  of  dimensions.  In  the  pres¬ 
ence  of  high- dimensional  data,  we  are  forced  to  project  the  data  into 
a  smaller-dimensional  hyperspace  and  search  for  interesting  behav¬ 
ior  at  that  level.  This  projection  is  most  easily  achieved  by  using  a 
single  representative  value  for  some  subset  of  inputs— essentially 
treating  them  as  fixed.  Input  variables  whose  range  is  nonzero  are 
plotted  on  the  available  axes  with  the  understanding  that  the  result¬ 
ing  outcomes  are  conditional  on  the  remaining  input  variables  being 
fbced.  Exploration  is  then  conducted  by  interactively  changing  the 
fixed  input  values  to  better  understand  the  relationships  between 
that  variable,  the  input  variables  shown  on  the  axes,  and  the  result¬ 
ing  MOE. 

In  this  chapter,  we  suggest  a  three-step  exploratory  method  for  eval¬ 
uating  MOPs  and  their  effects  on  MOEs.  We  apply  this  methodology 
to  the  two  vignettes  discussed  in  Chapters  Three  and  Four.  The  data 
exploration  process  is  dynamic  in  that  inferences  can  be  made  only 
by  varying  and  comparing  many  different  cases.  We  occasionally 
discuss  examples  in  which  the  dynamic  EDA  yielded  a  particularly 
interesting  outcome  for  one  of  the  vignettes.  In  those  cases,  the  EDA 
process  is  paused,  the  input  and  output  values  are  captured,  and  an 
analytical  narrative  is  included  to  support  the  outcome. 
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STOCHASTIC  INPUT  VARIABLES 

There  are  three  good  reasons  to  create  a  stochastic  simulation  to 
compute  measures  of  effectiveness  for  combat  outcomes  in  naval 
operations:  the  complex  interrelationships  between  variables  or 
between  stages  of  the  simulation  make  it  too  difficult  to  explicitly 
compute;  we  want  each  input  and  the  MOE  to  belong  to  the  finite  set 
of  possible  real-world  values  (e.g.,  we  either  kill  or  do  not  kill  a  red 
submarine — we  do  not  kill  fractional  submarines);  and  we  desire  to 
construct  a  measure  of  variability  for  each  MOE. 

Suppose  we  model  the  single-shot  probability  of  hit  (SSPH)  of  a 
SI^-ER  against  an  enemy  Kilo  according  to  a  Bernoulli  distribution 
with  parameter  p.  That  is,  p  is  the  probability  that  a  single  shot  will 
hit  the  submarine.  If  we  randomly  draw  n  values  (simulating  n  inde¬ 
pendent  shots)  from  the  Bernoulli  distribution,  the  set  of  possible 
outcomes  will  have  n  + 1  elements:  {0  success,  1  success, ...,  n  suc¬ 
cesses}.  Each  of  the  n  +  \  numbers  of  successes  is  a  possible  out¬ 
come  that  results  from  the  realization  of  the  binomial  distribution.  If 
the  random  variable  X  represents  the  number  of  successes,  then: 

P(X  =  x)= f ” V iorx  =  QX....n 

U/ 

with  E{X)  =  np,  and  Var(X)  =  np[l~p). 

If  we  used  the  expected  value  E{X)  =  np  as  the  number  of  successful 
hits  rather  than  drawing  from  the  binomial  distribution,  then  the  set 
of  possible  outcomes  is  not  limited  to  the  set  of  integers  {0,1, ...,  n). 
An  expected  value  calculation  may  result  in  an  outcome  that  would 
be  unachievable  in  a  real-world  setting  (e.g.,  if  np  is  not  an  integer). 

Suppose  SSPH  =  0.65  and  that  five  SLAM-ERs  are  fired  (we  assume 
the  ^h  missile  is  fired  even  if  the  Kilo  were  hit  and  destroyed  by  any 
of  the  first,  second,  ...,  [k-  l)th  missiles).  Then  the  distribution  of 
hits  is  depicted  in  Table  5.1  and  illustrated  in  Figure  5.1. 

Based  on  these  results,  we  can  expect  that  18.11  percent  of  all  simu¬ 
lations  will  result  in  exactly  two  out  of  five  hits.  If  our  MOE  were 


P(X=x) 
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Table  5.1 

Probability  Distribution, 
Bin  (5, 0.65) 


X 

P{X=^) 

0 

0.0053 

1 

0.0488 

2 

0.1811 

3 

0.3364 

4 

0.3124 

5 

0.1160 

“fraction  of  Kilo  hits,”  then  we  would  simulate  some  damage  inflic¬ 
tion  only  for  runs  where  one  or  more  hits  resulted  (approximately 
99.47  percent  of  the  runs). 
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Essentially,  we  may  consider  the  simulation-generation  process  as  a 
transfer  function  where  a  vector  of  random  input  variables  is  trans¬ 
formed  into  an  MOE.  If  the  distributions  of  the  input  variables  are 
known  and  the  distribution  of  the  function  can  be  computed  explic¬ 
itly,  there  is  no  need  to  simulate  outcomes  because  the  theoretical 
distribution  is  known.  However,  as  the  model  becomes  more  com¬ 
plex,  the  potential  need  for  simulation  becomes  greater.  For  exam¬ 
ple,  if  a  SIAM-ER  is  released  only  when  a  set  of  conditions  (weather, 
target  detection,  etc.)  is  met,  then  we  need  to  compute  the  distribu¬ 
tion  of  the  function  that  transforms  all  of  the  other  input  variables 
into  a  decision  to  shoot  or  not  shoot.  In  that  case,  even  though  the 
distributions  of  the  set  of  inputs  are  known,  the  sequence  of  events 
that  determines  if  the  shot  is  taken  is  not  as  straightforward.  As  the 
model  becomes  more  complex  when  more  input  variables  are  added, 
determination  of  the  outcome  (in  this  example,  the  fraction  of  Kilos 
destroyed)  increasingly  suggests  that  we  simulate  the  event  stochas¬ 
tically. 

EXPLORATORY  DATA  ANALYSIS 

Often,  we  are  less  concerned  with  computing  the  actual  value  and 
distribution  of  the  MOE  and  more  interested  in  MOE  sensitivity  to 
changes  in  the  input  variables.  We  are  also  less  interested  in  the  fre¬ 
quency  with  which  each  value  of  an  input  occurs  than  we  are  in  see¬ 
ing  how  much  a  change  in  the  value  impacts  our  MOE,  given  that  it 
does  occur.  For  that  reason,  we  generally  define  a  feasible  range  over 
which  an  input  will  occur  and  evaluate  the  MOE  at  each  value  of  the 
input  in  the  range,  allowing  each  discrete  value  of  the  input  to  occur 
with  equal  probability.  Once  we  understand  the  relationship  be¬ 
tween  the  input  variables  and  the  MOEs,  we  can  then  restrict  our  at¬ 
tention  to  the  range  of  input  values  more  likely  to  occur.  For  exam¬ 
ple,  suppose  blue  is  being  subjected  to  a  red  tactical  ballistic  missile 
(TBM)  strike  and  our  MOE  is  “percentage  of  airfield  damaged."  One 
input  variable  may  be  the  maximum  arrival  rate  of  red  TBMs  in  a 
time  period  that  may  be  a  Poisson  variable  with  X  =  100  TBMs.  In 
the  EDA,  we  would  evaluate  the  MOE  over  a  range  of  arrival  rates 
(e.g.,  X  =  |50,  75,  100,  125,  150})  to  understand  the  relationship  be¬ 
tween  arrival  time  and  the  MOE  and  seek  out  interesting  values  that 
ma.y  indicate  answers  to  such  questions  as,  “What  is  the  minimum 
arrival  rate  that  will  result  in  an  expected  percentage  of  airfield  dam- 
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aged  of  50  percent?”  Given  that  we  understand  the  relationship  be¬ 
tween  the  input  and  the  MOE,  we  can  then  increase  our  focus  on  the 
values  of  X  more  likely  to  occur  (perhaps  due  to  intelligence  esti¬ 
mates  of  IBM  inventory  and  firing  rate). 

To  perform  the  EDA,  we  suggest  selecting  a  small  set  of  possible  val¬ 
ues  for  each  input  and  viewing  the  MOE  over  many  possible  combi¬ 
nations  of  these.  Suppose  we  have  three  input  variables  and  one 
MOE  and  we  have  restricted  attention  to  five  levels  for  each  input  at 
which  we  evaluate  the  MOE.  Then,  there  are  5^  =  125  different  four¬ 
dimensional  points  for  which  we  can  explore  the  relationship  be¬ 
tween  the  input  variables  and  the  MOE.  Visualization  of  these  vari¬ 
ous  interactions  may  also  help  us  to  identify  relationships  between 
independent  variables. 

Using  traditional  graphical  representations,  our  visualization  capa¬ 
bilities  are  limited  to  a  small  number  of  dimensions.  This  implies 
that,  if  our  system  capability  is  (i- dimensional,  then  we  may  explore 
the  impact  of  no  more  than  d-l  inputs  on  the  MOE  at  one  time  (the 
remaining  dimension  is  reserved  for  the  MOE  itself).  To  facilitate 
EDA  over  a  potentially  large  number  of  inputs,  we  have  constructed 
simple  graphical  interfaces  both  for  the  missile  defense  vignette  in 
Chapter  Three  and  for  the  TCT  vignette  discussed  in  Chapter  Four. 
The  interface  allows  simultaneous  evaluation  of  three  input  variables 
(two  statically  and  one  dynamically  varied)  and  one  MOE  on  a  single 
graph.  Note  also  that  if  there  are  d  input  variables,  each  evaluated  at 
k  points,  then  the  number  of  possible  points  at  which  we  need  to 
evaluate  the  MOE,  can  grow  large  very  quickly.  Our  EDA  tool  pro¬ 
vides  a  way  to  easily  evaluate  a  large  number  of  input  combinations, 
even  when  d  is  moderate  (<15)  and  k  is  large  (>100). 

We  illustrate  the  use  of  this  tool  for  the  TCT  vignette  using  a  14- 
dimensional  input  set,  an  MOP  (“Effective  Time  Remaining”),  and  an 
MOE  (“Kill  Probability”).  First,  we  explain  how  the  resulting  graphs 
should  be  interpreted  in  the  context  of  expected  value  and  not  real- 
world  outcomes  of  the  process  being  modeled. 

EXPECTED  VALUE 

Earlier,  we  saw  how  stochastic  simulation  allowed  complex  systems 
to  be  modeled  in  such  a  way  that  each  simulated  input  belongs  to  the 
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set  of  possible  real-world  values.  In  EDA,  because  we  have  shifted 
our  focus  from  the  “distribution  of  outcomes"  to  the  “influence  of 
inputs  on  outcomes,"  the  need  for  real-world  outcomes  can  be  re¬ 
laxed.  Once  that  is  done,  we  find  it  easier  to  simplify  the  modeling  of 
the  naval  operations  by  employing  an  expected-value  methodology. 

Because  the  exploration  of  high-dimensional  data  is  difficult,  given 
limited  human  and  computer  visualization  capabilities,  we  need  a 
process  by  which  we  can  use  a  low-dimensional  analysis  to  under¬ 
stand  the  structure  in  high-dimensional  data.  Our  approach  is  to  di¬ 
vide  the  data  into  three  categories  (MOPs/MOEs,  design  variables, 
input  variables)  and  then  individually  evaluate  the  impact  of  each 
input  variable"  by  cycling  through  each  of  them  and  varying  their 
levels.  When  we  say,  “varying  the  levels,”  we  suggest  that  the  avail¬ 
able  levels  at  which  the  variable  may  be  evaluated  is  relatively  small. 
Alternatively,  we  can  examine  the  impact  of  combinations  of  input 
variables  and  thereby  assess  the  effects  of  interactions  among  them. 
This,  however,  is  rather  costly.  With  just  three  input  variables,  each 
of  which  has  three  levels,  we  get  3^  =  27  cases  to  examine. 

The  natural  question  is,  “At  what  level  do  I  set  the  variables  not  being 
considered?  The  natural  response  is,  “At  the  level  that  we  expect  it 
to  be.  The  choice  of  the  term  “expected  value”  requires  further  dis¬ 
cussion  because  it  has  two  meanings  in  the  context  of  the  EDA. 

Expected  Value  of  Distributions 

When  we  simulate,  we  attempt  to  represent  real-world  outcomes  as 
much  as  possible.  In  the  SLAM-ER  SSPK  example,  we  suggested  that 
simulation  would  result  in  «  + 1  possible  kill  outcomes.  Each  of  the 
outcomes  may  occur  with  some  nonzero  probability  and  a  fully 
stochastic  simulation  will  not  result  in  any  fractional  values  for  mis¬ 
sile  kills.  However,  in  the  EDA,  if  the  number  of  shots  taken,  ,  and 
the  SSPK,  pj,  are  considered  to  be  input  variables,  then  each  { ,  pA 
pair  will  have  rii  +  1  possible  outcomes.*  As  part  of  our  dimension 
reduction,  we  seek  to  represent  large  number  of  input  pairs  by  gen¬ 
erating  a  single  value  that  represents  the  weighted  average  of  the 


*Here,  the  subscripts  i  and  j  are  used  to  indicate  the  different  levels  at  which  we  are 
evaluating  the  input  variables. 
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distribution  of  that  particular  pair  of  inputs.  The  summary  value  that 
we  use  is  the  mean  or  “expected  value.”  Suppose  we  look  at  the  SSPK 
at  three  points,  pj  =  {0.60,  0.65,  0.70},  and  consider  taking  between 
four  and  six  shots,  rii  =  {4,  5,  6}.  From  our  distribution  in  Figure  5.1, 
we  know  that  the  { rif,  pj}  pair  {5,  0.  65}  has  six  different  outcomes 
and  that  the  expected  value  is  { rif,  pj}  =  5  x  0.65  =  3.25  kills  per  inter¬ 
cept  event.  Note  that  3.25  kills  is  not  a  possible  outcome  for  five 
attempted  Kilo  interceptions.  Yet,  we  use  3.25  as  an  input  value  in 
the  EDA. 

We  are  not  as  interested  in  the  actual  level  of  kills  as  we  are  in  finding 
the  relationship  between  SSPK  and  kills,  number  of  shots  taken  and 
kills,  and  the  number  of  shots  taken  and  SSPK  (the  two  input  vari¬ 
ables  {rii,  Pj}  are  independent  in  this  case,  but  not  in  general).  By 
taking  expected  values,  the  number  of  possible  outcomes  has  been 
reduced  from  54  (5  x  3  +  6  x  3  +  7  x  3)  to  nine  and  the  set  of  triplets 
{rii,  Pj,  MOEy}  can  be  represented  as  points  on  a  three-dimensional 
surface  plot.  Without  the  expected-value  calculation,  at  least  one 
more  dimension  would  be  required  to  represent  the  different  out¬ 
comes  that  may  result  from  each  pair  and  perhaps  another  dimen¬ 
sion  to  indicate  the  frequency  at  which  each  of  the  outcomes  will 
theoretically  occur. 

As  the  analysis  is  extended  to  include  more  input  variables,  the 
number  of  possible  combinations  of  input  vectors  can  become  stag¬ 
geringly  large.  By  taking  the  expected  value  for  each  vector,  it  is  eas¬ 
ier  to  summarize  the  high-dimensional  data. 

Expected  Value  of  an  Input  Variable 

Expected  value  has  been  discussed  as  a  method  for  summarizing  the 
distribution  that  results  from  the  interaction  of  several  input  param¬ 
eters  in  terms  of  a  single  value.  Expected  value  may  be  used  in  an¬ 
other  sense  when  input  parameters  are  discussed  individually.  In 
the  SLAM-ER  versus  Kilo  example,  0.65  was  used  as  the  value  for  the 
SSPK.  The  choice  of  0.65  is  based  on  some  information  about  the 
SLAM-ER  and  its  historical  or  simulated  killing  power  against  Kilos. 
However,  such  questions  as,  “What  if  the  SLAM-ER  performs  better 
than  the  test  data  indicate?”  or  “What  if  weather  degrades  the  SLAM- 
ER’s  visual  capability  and  degrades  the  SSPK?”  may  be  of  interest. 
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Essentially,  0.65  represents  the  expected  value,  and  values  that  we  in¬ 
vestigate  that  are  different  from  0.65  form  the  basis  for  exploratory 
analysis.  The  expected  value  is  the  “base  case"  and  the  sensitivity  of 
the  MOP/MOE  based  on  small  changes  in  inputs  can  be  evaluated. 

RAND  EDA  TOOL 

A  complete  EDA  has  three  phases: ^ 

•  Phase! — an  introductory  visual  exploration:  This  allows  all  pos¬ 
sible  inputs  to  occur  with  equal  probability.  This  phase  is  used  to 
gain  a  better  understanding  of  the  relationship  between  input 
variables  and  the  MOPs/MOEs. 

•  Phase  II— a  focused  analysis:  The  objective  is  to  restrict  the 
exploration  to  ranges  of  input  variables  more  likely  to  occur. 

•  Phase  III — a  full-scale  stochastic  simulation:  The  simulation 
does  not  use  the  expected  value  of  known  distributions  but  rather 
randomly  draws  from  them  at  each  simulation  replication. 

The  RAND  EDA  tool  does  not  provide  the  capability  for  the  third 
phase  because  other  simulation  systems  are  already  in  place.  Rather, 
we  choose  to  focus  on  the  first  two  phases  where  important  relation¬ 
ships  are  discovered  and  the  expected  impact  of  policy  decisions  can 
be  made  before  undertaking  the  more  costly  task  of  simulation. 

TCT  VIGNETTE  APPLICATION 

The  data  elements  for  the  TCT  scenario  are  organized  by  the  three 
categories:  input  variables,  design  variables,  and  MOEs  as  depicted 
in  Table  5.2. 

Phase  I  Analysis 

For  this  vignette  we  have  14  variables,  an  MOP,  and  an  MOE.  Note 
that  the  last  four  input  variables  correspond  only  to  the  MOE. 
Because  a  16-dimensional  space  cannot  be  visualized  (11  input  vari- 


2SeeBankes(1993). 


Exploratory  Analysis  Tool  111 


Table  5.2 

Data  Elements  for  TCT  Vignette 


Input  Variables 

Design  Variables 

MOPs/MOEs 

Kilo  submerge  time 

Mean  CV  processing  (0-2)  hours 

Time-on-target 

Network  complexity  penalty 

Mean  initial  SSN  report  delay 
(0-2)  hours 

Kill  probability 

SubGroup  processing  delay 

CVN  processing  delay 

F/A-18  or  UCAV  flight/ 
weapon  delivery  time 

DDG  processing  delay 

CG  processing  delay 

Sweep  width 

Missile  (SLAM-ER)  speed 
Mean  time  between  updates 
Kilo  speed 

Network-centricity  (platform¬ 
centric,  network-centric, 
futuristic  network-centric) 

NOTE:  Design  variables  do  not  change.  A  range  of  values  for  each  is  plotted  provided 
it  is  quantitative.  If  the  variable  is  categorical  (such  as  network- centricity),  changes 
are  activated  through  various  controls  (slider  bars,  radio  buttons,  etc.}. 


ables  +  3  design  variables  -i-  2  MOPs/MOEs),  the  introductory  visual¬ 
ization  phase  of  exploratory  analysis  is  accomplished  as  follows: 

•  Separate  the  MOP  and  the  MOE  into  two  separate  graphs. 

•  Plot  the  quantitative  design  variables  on  the  x-  and  y-axes  and 
each  MOP/MOE  on  the  z-axis. 

•  Enable  the  radio  button  corresponding  to  the  network  topology 
being  studied. 

•  Individually  move  the  slider  bars  for  the  first  seven  input  vari¬ 
ables  in  Table  5.2  to  understand  the  relationships  between  the 
input  variables,  the  design  variables,  and  the  MOP/MOE. 

•  Vary  the  slider  bars  for  the  last  four  input  variables  to  understand 
the  relationship  between  the  MOP  and  the  MOE. 

Figure  5.2  is  a  screen  image  of  the  user  interface.  It  depicts  how  the 

MOP/MOE  response  surfaces  appear  for  what  is  referred  to  as  the 
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Figure  5.2— RAND  EDA  Tool  for  TCT  Analysis  (Phase  I) 

“futuristic  network”  (Figure  3.9).  Some  interesting  observations  can 

be  made: 

•  As  the  value  of  the  quantitative  design  variables  increase,  the 
MOP  and  the  MOE  become  smaller.  This  is  not  surprising  in  that 
increasing  latencies  will  increase  overall  latency  and  therefore 
reduce  the  likelihood  that  the  target  will  be  attacked  successfully. 

•  Figure  5.2  shows  that  the  MOP  and  the  MOE  are  nearly  always 
more  sensitive  to  changes  in  the  Mean  CV  Processing  Time  than 
they  are  to  the  Mean  Initial  SSN  Report  Delay.  Table  5.3  lists  a 
set  of  approximate  partial  derivatives, 

dMOE 

dXi  ' 

where  x/  =  {CV  Processing  Time,  SSN  Report  Delay},  for  the  MOE 
evaluated  at  nine  different  points. 
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Table  5.3 

MOE/MOP  Sensitivities 


Mean  CV  Process¬ 
ing  Time  (xj) 


0.20 

0.20 

0.20 

0.50 

0.50 

0.50 

0.80 

0.80 

0.80 


Mean  Initial  SSN 
Report  Delay  (X2) 


0.50 

1.00 

1.50 

0.50 

1.00 

1.50 

0.50 

1.00 

1.50 


dMOB  dMOE 


dxi 

0X2 

-0.11 

-0.54 

-0.22 

-0.35 

-0.31 

-0.29 

-0.02 

-0.58 

-0.07 

-0.39 

-0.10 

-0.32 

-0.02 

-0.59 

-0.04 

-0.40 

-0.04 

-0.34 

•  Regardless  of  the  detection  capabilities,  the  kill  probability  is 
zero  when  no  effective  time  remains.  Although  this  restates  the 
obvious,  it  does  emphasize  the  fact  that  for  TCTs,  time  is  indeed 
critical!  It  is  also  a  good  “sanity  check.” 

As  the  analyst  moves  through  the  different  combinations  that  result 
from  dynamic  interaction  with  the  slider  bars  and  the  network- 
centricity  radio  button,  the  goal  of  phase  I  will  be  accomplished — to 
gain  an  understanding  of  the  relationships  between  input  variables, 
design  variables,  and  Ae  MOP/MOE. 

Phase  II  Analysis 

At  the  outset  of  phase  II  of  the  EDA,  the  analyst  has  completely  ex¬ 
plored  the  16- dimensional  space  by  implicitly  assuming  that  each 
grid  point  on  the  response  surface  for  a  fixed  set  of  input  variables 
occurs  with  equal  probability.  The  analytical  focus  now  shifts  to  ex¬ 
amining  restricted  ranges  of  a  subset  of  input  variables  more  likely  to 
occur.  This  is  generally  accomplished  by  setting  each  input  variable 
to  its  expected  value.  These  are  summarized  in  Table  5.2  above  for 
each  of  the  network  configurations. 

By  setting  each  input  variable  to  its  expected  value,  a  static  picture  of 
the  response  surface  is  obtained.  This  represents  a  best  estimate  of 
the  MOEs  across  the  range  of  quantitative  design  variables  and  is 
therefore  considered  to  be  the  “base  case.”  In  phase  II,  deviations 
from  the  “base  case”  are  explored  to  get  an  idea  of  the  range  of  values 
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that  may  occur  in  the  event  that  the  actual  values  of  the  input  vari¬ 
ables  differ  from  the  expected  values.  In  the  exploratory  tool,  this 
second  phase  is  provided  only  for  the  futuristic  network-centric  case. 
When  this  case  is  enabled  via  the  radio  button,  the  user  may  then 
click  on  the  "Explore  cases"  command  button  that  activates  the 
phase  II  analysis. 

Figure  5.3  depicts  the  phase  II  analysis  screen.  In  this  example,  the 
expected  values  of  the  SubGroup,  CV,  UCAV,  and  complexity  penalty 
have  been  fixed.  A  subset  of  the  input  variables  is  depicted  and  can 
be  varied  using  the  slider  bars  provided.  The  remaining  input/design 
variables  are  evaluated  at  a  small  set  of  points:  their  individual 
means,  one-half  standard  deviation  below  their  means,  one  standard 
de^iation  above  their  means,  and  two  standard  deviations  above 
their  means  (see  Table  5.4).  Since  we  vary  four  input  variables  at  four 
points,  there  are  4^  =  256  different  outcomes  for  each  combination  of 


RANDMfl  )44S-5.3 


Figure  5.3— RAND  EDA  Tool  for  TCT  Analysis  (Phase  II) 
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Table  5.4 

Mean  and  Standard  Deviation  Settings  for  the  Futuristic  Network 


Input  Variable 

Variants 

Mean  (1/  A) 
in  Minutes 

1/2A 

2tX 

SIX 

DDG  processing  delay 

15 

7.5 

30 

45 

CG  processing  delay 

10 

5 

20 

30 

CVN  processing  delay 

17 

8.5 

34 

51 

SSN  initial  report  time 

15 

7.5 

30 

45 

inputs  implied  by  the  position  of  the  four  slider  bars.^  Each  case 
generates  a  value  for  the  MOP  and  for  the  MOE.  These  values  are 
then  displayed  in  graphical  form.  The  chart  at  the  right  in  Figure  5.3 
illustrates  the  interdependence  of  the  MOP  (effective  time  to  attack 
the  enemy  submarine)  and  the  MOE  (probability  of  kill)  generated 
from  the  256  points. 

The  reason  for  evaluating  both  the  MOP  and  the  MOE  at  a  discrete 
set  of  points  is  to  assess  the  worst-  and  best-case  scenarios.  For  ex¬ 
ample,  from  Figure  5.2,  we  learn  that  an  increase  in  the  CVN  process¬ 
ing  time  has  a  very  large  impact  on  either  the  MOP  or  the  MOE.  So,  it 
may  be  of  interest  to  assess  their  values  in  a  “worst-case”  situation 
where  the  value  of  the  input  is  two  standard  deviations  above  its 
mean.  In  this  phase,  it  is  no  longer  assumed  that  the  2/  A  case  will 
occur  with  equal  probability  with  the  expected-value  case  (for  most 
distributions).  However,  it  is  understood  that  the  2/  X  may  occur 
with  knovm,  nonzero  probability. 

Once  the  slider  bars  are  dynamically  moved,  the  plotted  points  are 
observed  to  see  if  they  tend  to  cluster  in  certain  regions  or  if  they 
tend  to  separate  for  certain  values  of  input  variables.  Once  that  rela¬ 
tionship  is  understood,  the  slider  bars  may  be  set  at  their  expected 
values  and  focus  can  now  shift  to  the  examination  of  specific  cases. 
For  example,  there  appears  to  be  two  points  in  Figure  5.3  where  both 
measures  are  higher  than  any  other  points  in  the  256  cases.  In  fact, 
their  values  can  be  found  by  placing  the  mouse  over  the  point  of 


^Of  course,  varying  more  variables  or  selecting  more  variants  for  each  will  produce 
more  alternatives.  Nothing  is  sacred  about  four  variables  and  four  variants  each. 
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interest— these  two  yield  values  of  {1.60,  0.683}  and  {1.61,  0.683}. 
Below  the  graph  section,  the  input  data  values  and  resulting  MOEs 
are  available,  and  so  the  analyst  may  then  look  up  the  values  that 
generated  the  interesting  point  on  the  graph. 

Analysis  of  Polling  Options 

We  now  apply  the  process  to  the  polling  options  for  the  futuristic 
network  first  presented  in  Table  4.1  and  reproduced  here  as  Table  5.5 
for  convenience. 

The  research  question  is,  “How  should  the  platform  assigned  to 
launch  the  UCAV  be  designated?”  This  is  essentially  a  command  and 
control  question  that  addresses  the  way  the  richly  connected  net¬ 
work  is  utilized  to  support  combat  operations.  The  three  choices  of¬ 
fered  have  implications  for  the  effective  time  available  to  attack  the 
Kilo.  All  three  are  associated  with  the  times  required  for  collabora¬ 
tion  and  UCAV  fly-out.  In  Table  5.5,  the  platform  collaboration  times 
and  the  UCAV  fly-out  times  are  listed  for  all  three  options. 

Polling  at  execution  time:  This  is  the  most  reliable  method  in  the 
sense  that  the  combatant  who  can  get  a  UCAV  to  the  target  most 

Table  5.5 

Future  NCW  Polling  Variants 


Option 

Process 

Impact  on  Operations 

Complete  polling 
at  execution  time 

Poll  all  potential  combat¬ 
ants  with  UCAVs  and  select 
the  one  that  can  get  to  the 
target  quickest 

Large  cost  in  collaboration  time 

Fastest  fly-out  time  for  UCAV 

Periodic  selection 
ofa  subset  of 

Poll  a  select  subset  of  com¬ 
batants  with  UCAVs  con- 

Less  cost  in  collaboration  time 

combatants  with 

sidered  to  be  in  the  best 

Moderate  increase  in  fly-out 

UCAVs 

position  to  respond.  Repeat 
this  process  periodically 

time 

Periodic  complete 

Poll  all  combatants  with 

Moderate  cost  in  collaboration 

polling  of  com¬ 
batants  with 

UCAVs  periodically  and 
designate  one  as  the  “duty" 

time 

UCAVs 

launcher 

Possibly  greatest  fly-out  time 
for  the  UCAV 
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quickly  is  always  selected.  However,  considerable  time  can  be  ab¬ 
sorbed  by  collaborating  to  arrive  at  an  ‘‘optimal”  selection  based 
time  to  launch  a  UCAV  (which  may  depend  on  readiness)  as  well  as 
distance  to  the  target. 

Polling  of  a  subset  at  execution  time:  In  this  case,  a  periodically  pre¬ 
selected  subset  of  the  platforms  with  the  UCAV  is  polled  at  execution 
time.  Because  the  number  of  platforms  polled  is  reduced,  the  col¬ 
laboration  time  required  at  execution  is  not  as  great.  The  fact  that 
the  preselection  is  time-consuming  has  little  impact  on  the  delay  at 
execution  time.  The  reliability  of  the  preselected  choice  in  terms  of 
the  time  required  to  reach  the  target  is  however,  reduced.  This  is  be¬ 
cause  it  relies  on  a  best-estimate  process  and  because  the  data  on 
which  a  best  estimate  was  developed  may  not  apply  at  the  time  of 
execution.  UCAV  launch  readiness  may  have  deteriorated  in  the  in¬ 
terim,  for  example.  The  result  is  that  combined  time  for  UCAV 
launch  and  fly-out  can  be  extended. 

Periodic  complete  polling:  In  this  case,  the  entire  set  of  platforms 
with  the  UCAV  is  polled  periodically.  The  polling  takes  place  prior  to 
the  operation,  meaning  that  little  time  is  spent  deciding  which  plat¬ 
form  will  launch  the  UCAV  at  execution  time.  The  reliability  of  the 
preselected  choice,  however,  is  less  reliable  than  selection  at  execu¬ 
tion  time.  In  this  case,  the  fact  that  all  platforms  are  polled  mitigates 
the  deficiency  somewhat.  The  impact  on  fly-out  time  for  the  UCAV  is 
generally  greater  than  the  first  case. 

Analysis  of  the  Three  Polling  Cases 

Table  5.6  lists  the  mean  times  associated  with  the  three  cases  dis¬ 
cussed.  Note  that  only  the  times  likely  to  vary  based  on  the  condi¬ 
tions  described  are  listed.  The  values  for  all  other  variables  (input 
and  design)  are  fixed.  For  each  case,  there  are  441  possible  alterna¬ 
tives  corresponding  to  the  grid  points  of  the  EDA  tool  shown  in  Fig¬ 
ure  5.2.  Although  not  shown,  21  data  points  on  both  the  x-  and  y- 
axes  thus  produce  441  possible  points  on  the  z-surface.  The  fly-out 
time  is  fixed  for  each  case.  Note  that  the  two  other  times  associated 
with  the  attack  sequence  (UCAV  launch  and  SLAM-ER  fly-out)  are 
not  affected  and  therefore  remain  fixed. 
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Table  5.6 

Time  Estimates  for  Polling  Variants 


Option 

DDG 

Polling 

CG 

Polling 

CVN 

Polling 

CV 

Polling 

UCAV 

Fly- 

Out 

Case  I:  complete  polling  at 
execution  time 

15 

10 

17 

17 

5 

Case  II:  periodic  selection 
from  a  subset  of  UCAV 
platforms 

8 

7 

— 

20 

Case  III:  periodic  complete 
polling  of  UCAV  platforms 

8 

7 

9 

9 

10 

Figure  5.4  illustrates  the  analysis  tool  needed  to  assess  the  relative 
effectiveness  of  the  three  cases.  Access  to  this  tool  is  from  the  screen 
depicted  in  Figure  5.2.  The  button  titled  “Frequency  by  Network  De¬ 
sign”  provides  access  to  the  screen  depicted  in  Figure  5.4. 
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Figure  5.4 — Comparing  Alternative  Network  Designs 
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The  graphic  depicted  in  Figure  5.4  is  a  histogram  of  the  441  alterna¬ 
tives  generated  by  a  single  case  as  described  above.  All  three  network 
configurations  are  included  on  a  single  figure.  In  this  example,  we 
will  only  be  interested  in  the  futuristic  network  case  across  the  three 
sets  of  vciriable  settings  in  Table  5.5.  The  x-axis  in  the  figure  is  the  ef¬ 
fective  expected  time  available  to  attack  the  target  (the  value  T  de¬ 
scribed  in  Chapter  Three)  and  the  y-axis  is  the  fraction  of  the  441  al¬ 
ternatives  that  resulted  in  the  x-axis  times.  Therefore,  clustering  of 
occurrences  to  the  right  of  the  figure  is  desirable.  Note  that  in  the 
sample,  the  platform-centric  network  is  skewed  to  the  left  somewhat 
with  only  a  few  occurrences  exceeding  one  hour.  The  network¬ 
centric  case  fares  a  bit  better  with  no  alternatives  below  30  minutes 
and  with  the  largest  concentrations  being  between  60  and  80  min¬ 
utes.  However,  the  futuristic  network  is  clearly  superior  with  no 
alternatives  less  than  84  minutes.^ 

UCAV  Analysis 

Figures  5.5  through  5.7  depict  the  results  of  setting  the  five  input 
variables  in  Table  5.5  to  the  three  values  depicted.  Only  the  futuristic 
network  cases  in  each  are  relevant  to  this  analysis  (the  unfilled  bars 
in  each  figure).  Note  that  the  maximum  time  available  to  attack  the 
target  for  any  of  the  cases  is  1.755  hours,  or  approximately  105  min¬ 
utes.  This  means  that  the  minimum  effective,  expected  latency  is 
approximately  15  minutes.  That  is,  factoring  in  all  the  positive  effects 
of  collaboration  and  the  negative  effects  of  complexity,  the  minimum 
effective,  average  time  required  to  get  the  SLAM-ER  to  the  target  area 
is  15  minutes. 

The  analysis  focuses  on  the  measure  of  performance  only.  Because 
the  MOE  is  directly  proportional  to  the  MOP  for  fixed  search  parame¬ 
ters,  this  is  adequate.  Table  5.7  summarizes  the  frequencies  depicted 
in  each  of  the  cases.  If  we  focus  on  the  maximum  effective  time 
available  (105  minutes),  it  is  clear  that  periodic  polling  (Case  III)  is 
superior  with  58  percent  of  the  441  alternatives  or  approximately  256 


'^These  times  are  all  based  on  a  two -hour  window.  That  is,  the  enemy  BCilo  will 
submerge  within  two  hours. 
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Frequency  of  outcomes 
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Figure  5.5 — Polling  All  Platforms  at  Execution  Time 
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Figure  5.6— Polling  a  Subset  of  UCAV  Platforms  at  Execution  Time 


alternatives  allowing  for  this  much  search  time.  If  we  focus  on  the 
100-minute-time-available  case,  the  periodic  selection  of  a  subset  of 
UCAV  platforms  (Case  II)  is  superior  with  71  percent  of  the  441  alter¬ 
natives,  or  approximately  313  alternatives  allowing  for  this  much 
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Figure  5.7 — Periodic  Prepolling  of  All  UCAV  Platforms 


Table  5.7 

Results  of  Alternative  UCAV  Platform  Selection  Processes 
for  the  Futuristic  Network 


Time  Available 

105  min  100  min 

95  min 

Case  I:  Complete  polling  at  execution  time 

Case  11;  Periodic  selection  from  a  subset  of  UCAV 

38 

53 

9 

platforms 

Case  III:  Periodic  complete  polling  of  UCAV 

29 

71 

0 

platforms 

58 

42 

0 

NOTE:  Entries  in  the  table  represent  the  percentage  of  the  441  alternatives  in  each 
category. 


search  time.  Note  that  Cases  II  and  III  together  dominate  Case  I, 
polling  all  platforms  at  execution  time. 

The  results  suggest  that  Case  III  is  the  preferred  way  to  operate. 
However,  as  mentioned  earlier,  this  should  be  the  beginning  of  a 
more  detailed  assessment  of  the  alternatives  in  Case  III  to  determine 
why  58  percent  of  the  alternatives  yielded  the  105-minute  time  avail¬ 
able.  The  analyst  may  wish  to  examine  the  effects  of  other  variables 
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to  include  those  associated  with  the  search  equation.  Also,  it  is  im¬ 
portant  that  before  real  analysis  is  conducted  using  these  concepts, 
considerable  validation  and  calibration  must  be  accomplished. 

MISSILE  DEFENSE  APPLICATION 

We  next  perform  the  first  phase  of  the  EDA  on  the  missile  defense 
scenario.  Phase  II  of  the  EDA  is  not  developed  here  because  the  al¬ 
ternative  network  configurations  are  depicted  in  the  phase  I  displays. 

The  data  elements  for  the  missile  vignette  scenario  are  organized  by 
the  three  categories:  input  variables,  design  variables,  and  MOEs  as 
depicted  in  Table  5.7. 

Phase  I  Analysis 

For  this  vignette  we  have  23  variables  and  two  MOEs.  Because  a  25- 
dimensional  space  cannot  be  visualized  (21  input  variables  +  2  design 
variables  +  2  MOEs),  the  introductory  visualization  phase  of  ex¬ 
ploratory  analysis  is  accomplished  as  follows: 

•  Separate  the  two  MOEs  into  two  separate  graphs. 

•  Plot  the  quantitative  design  variables  on  the  x-axis  and  each 
MOE  on  the  y-axis. 

•  Split  the  input  variables  into  the  appropriate  side  (red  or  blue) 
and  individually  move  the  slider  bars  for  input  variables  in  Table 
5.7  to  understand  the  relationships  between  the  input  variables, 
the  design  variables,  and  the  MOEs.  The  plotted  MOEs  are  up¬ 
dated  simultaneously  on  the  red  and  blue  pages  where  input 
variables  are  set. 

Figures  5.8  and  5.9  are  screen  images  of  the  user  interface.  Figure  5.8 
depicts  blue  inputs  and  Figure  5.9  depicts  red  inputs.  In  Figure  5.9, 
the  user  is  able  to  use  the  scroll  bars  to  set  the  true  arrival  rate  for  red 
cruise  missiles  and  ballistic  missiles.  In  the  example,  we  have  an  at¬ 
tempted  cruise  missile  saturation  where  nearly  all  cruise  missiles  ar¬ 
rive  uniformly  in  each  subinterval  of  the  third  interval.  Following 
that,  in  interval  four,  a  majority  of  the  ballistic  missiles  are  delivered 
uniformly  in  each  sub  interval. 
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Table  5.8 

Data  Elements  for  Missile  Defense  Vignette 


Measures  of 

Input  Variables  Design  Variables  Effectiveness 

Threatening  red  ballistic  missile 
count 

Threatening  red  ballistic  missile 
arrival  distribution 

Threatening  red  cruise  missile 
count 

Threatening  red  cruise  missile 
arrival  distribution 
Percentage  of  red  cruise  missiles 
aimed  atA(b) 

Cruise  missile  single-shot  prob¬ 
ability  of  damage  (SSPD) 

Cruise  missile  damage  threshold 
Blue  ACM  inventory  per  ship 
Blue  ACM  service  rate  (per 
subinterval) 

Blue  ACM  SSPK 
Blue  ABM  inventory  per  ship 
Blue  ABM  service  rate  (per 
subinterval) 

Blue  ABM  SSPK 
CIWS  SSPK 
Blue  shooting  policy 
Percentage  of  second  shots 
(when  shooting  policy  is  not 
“shoot”) 

Information  quality 
Mean  collaboration  time 
Geometry  overlap  (COP  case 
only) 

Future  attack  decision  weight 
(COP  case  only) 

NOTE;  As  in  the  TCT  case,  design  variables  do  not  change  and  a  range  of  values  for 
each  is  plotted,  provided  it  is  quantitative.  Rather  than  plotting  the  various  MOEs 
against  time,  we  plot  against  subintervals.  All  time-dependent  variables  (arrivals, 
service  rates,  etc.)  are  then  converted  to  the  subinterval  scale.  If  the  variable  is  cate¬ 
gorical  (such  as  shooting  policy),  changes  are  activated  through  various  controls 
(slider  bars,  radio  buttons,  etc.). 


Network-centricity  (divided  Mean  remaining 


duties,  COP,  cooperative 
engagement) 

Subinterval  length 


survival 

Cumulative 
ballistic 
missile  leaks 
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Figure  5.8 — Screen  Shot  of  Blue  Inputs 
Measures  of  Effectiveness 

The  two  MOEs  used  in  this  analysis  are  the  mean  number  of  ships 
surviving  and  the  number  of  ballistic  missile  leakers.  Each  is  de¬ 
scribed  below. 

•  Mean  Remaining  Survival  in  subinterval  j  is  computed  as 


where  Ni  is  the  number  of  leakers  required  to  destroy  the  ship 
and  is  the  number  of  cruise  missiles  that  have  leaked  through 
to  ship  i  up  to  subinterval 

^See  the  discussion  of  the  terminal  defense  queue  in  Chapter  Three  for  a  complete 
discussion  of  these  terms. 
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RMDMR1449-5.9 


Figure  5.9 — Screen  Shot  of  Red  Inputs 


•  Ballistic  Missile  Leaks  in  subinterval  j  are  computed  as 

where  Bj  is  the  cumulative  TBM  leakers  through  subinterval  j, 
and  hjt  is  the  number  of  TBM  leakers  in  subinterval  k. 

Observations 

The  following  are  a  few  initial  results  that  derive  from  examining  the 

outputs: 

•  When  the  red  cruise  missile  damage  threshold  is  the  same  as  the 
cruise  missile  single- shot  probability  of  damage,  then  only  one 
cruise  missile  is  required  to  take  an  Aegis  cruiser  out  of  commis¬ 
sion  (OOC).  This  is  a  straightforward  result  from  the  calculation 
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ofthe  number  ofleakers  required  for  OOC.  That  is,  when  Pa^Pd> 
we  have  that: 


_In(I--;7^)^ln(I-p^)_ 
ln(l-pj  Inil-pa)  * 

•  When  the  missile  arrival  rate  is  equal  across  all  intervals  and 
subintervals,  information  quality  has  no  impact  on  the  decisions. 
This  is  because,  in  the  absence  of  information,  the  default  deci¬ 
sion  is  based  on  a  uniform  arrival  rate  of  enemy  assets. 

•  If  ACM  inventories  are  not  constraining  so  that  both  ships  can 
attempt  to  intercept  all  incoming  cruise  missiles,  the  remaining 
survival  MOE  for  the  cooperative  engagement  case  will  be  greater 
than  or  equal  to  the  MOE  for  the  shared  COP  case.  This  is 
because  a  higher  kill  probability  is  achieved  when  two  ships  are 
attempting  to  intercept  incoming  cruise  missiles  instead  of  one 
(unless  the  SSPK  is  1  or  0).  In  the  nonconstraining  inventory  ex¬ 
ample,  the  cooperative  engagement  decision  will  always  be  for 
all  surviving  ships  to  attempt  cruise  missile  intercept,  whereas  in 
the  shared  COP  case,  both  surviving  ships  will  attempt  to  inter¬ 
cept  only  the  cruise  missiles  in  the  geometric  overlap.  When  the 
geometry  overlap  is  one,  the  two  cases  will  have  equal  values  for 
the  remaining  survival  MOE. 

•  There  are  instances  when  the  remaining  survival  MOE  is  greater 
for  the  shared  COP  case  than  for  the  cooperative  engagement 
case.  This  occurs  because  the  objective  of  the  cooperative  en¬ 
gagement  decision  is  to  prolong  the  ability  of  at  least  one  ship  to 
perform  the  ACM  role,  not  to  minimize  cruise  missile  leaks.  In 
the  cooperative  engagement  case,  a  large  number  of  cruise  mis¬ 
sile  leakers  may  be  allowed,  so  long  as  the  expected  number  of 
leakers  realized  by  the  end  of  the  subinterval  still  allows  the  ship 
to  function  in  an  ACM  role.  Figure  5.8  illustrates  an  example  of 
this  where  the  two  ships  in  the  cooperative  engagement  case 
sustain  more  damage  in  the  initial  subinterval  but  whose  coop¬ 
erative  planning  allows  them  to  last  for  two  additional  subinter¬ 
vals  than  in  the  COP  case.  The  central  authority  in  the  coopera¬ 
tive  engagement  case  decided  to  have  only  one  ship  defend 
against  cruise  missiles  for  the  first  six  periods  and  then  have  both 
ships  assume  an  ACM  role. 
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When  ACM  inventories  are  constraining  and  future  expected 
cruise  missile  attacks  are  large,  larger  vailues  of  the  future  attack 
decision  weight  often  lead  to  an  early  destruction  of  a  ship.  This 
is  because  a  larger  number  of  missiles  arriving  in  the  current  pe¬ 
riod  are  left  to  be  intercepted  by  the  CIWS.  Because  the  effective 
kill  probability  using  only  one  friendly  asset  may  be  significantly 
smaller  than  using  two,  more  leaks  occur  in  the  current  period 
and  the  ship  may  be  taken  OOC  earlier. 

For  a  fixed  set  of  inputs,  increasing  or  decreasing  information 
quality  often  has  little  impact  on  altering  the  decision.  This  will 
occur  when  the  projected  distribution  of  arrivals  in  a  subinterval 
is  near  uniform  and  the  difference  between  the  actual  and  pro¬ 
jected  is  small.  It  will  also  occur  when  inventory  levels  are  such 
that  it  is  impossible  to  take  advantage  of  the  information.  The 
computed  expected  missile  arrivals  in  each  subinterval  is 
bounded  by  both  the  number  of  remaining  missiles  divided  by 
the  number  of  remaining  subintervals  and  the  actual  number  of 
arrivals.  In  many  cases,  decisions  are  the  same  for  all  values 
within  that  range,  and  so  varying  information  quality  has  no  im¬ 
pact  on  the  action  taken  by  the  ships. 


Chapter  Six 

CONCLUSION 


We  conclude  this  report  as  we  began  it:  by  emphasizing  the  need  for 
new  measures  and  metrics  that  incorporate  the  effectiveness  of 
C4ISR  systems,  procedures,  and  equipment  and  their  effect  on  com¬ 
bat  outcome.  The  assertion  is  generally  made  that  a  richly  connected 
network  of  C4ISR  facilities  and  weapon  systems  will  improve 
decisionmaking  and  therefore  favorably  impact  combat  operations. 
This  may  be  true,  but  as  yet  we  have  no  systematic,  universally 
accepted  way  to  demonstrate  the  truth  of  this  claim.  Consequently, 
analysis  continues  along  two  seemingly  independent  paths:  one 
assessing  the  performance  of  C4ISR  systems  and  one  that  focuses  on 
the  effects  of  weapon  systems  on  combat  outcomes.  The  longer  ana¬ 
lysts  continue  to  employ  only  traditional  MOEs  in  this  bifurcated 
way,  the  longer  they  ignore  the  important  effects  of  information  and 
decisionmaking  on  combat  outcomes.  The  services  have  recognized 
how  important  this  is  and  have  begun  to  sponsor  important  research 
in  this  area.  This  report  has  focused  on  the  Navy’s  early  attempts  at 
codifying  one  approach.  Clearly,  much  remains  to  be  done  before 
accepted  practices  can  be  established.  The  work  presented  here  is 
just  a  beginning. 

In  this  chapter,  we  conclude  with  a  few  first  principles  developed  in 
the  process  of  conducting  this  research.  The  focus  is  on  methodol¬ 
ogy  rather  than  results  in  that  most  of  this  work  is  theoretical  and 
remains  to  be  verified,  validated,  and  calibrated.  However,  lessons 
can  be  learned  from  theoretical  work,  and  we  state  these  findings 
next. 
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REPRESENTING  NETWORK- CENTRIC  OPERATIONS 

NCW  is  not  just  about  networks.  Networks  are  necessary  but  are  not 
sufficient  to  achieve  effective  network- centric  operations.  Much  has 
been  made  of  the  relationship  between  the  ‘‘size"  of  the  network  and 
its  efficiency.  The  computer  network  analogy  is  often  cited  to  illus¬ 
trate  that  a  more  richly  connected  network  ipso  facto  improves 
overall  performance.  The  claim  is  that  performance  improves  with 
the  square  of  the  number  of  nodes  in  the  network  based  on  the  work 
done  in  the  1970s  by  Robert  Metcalf  in  assessing  the  effectiveness  of 
the  Hawaiian  AlohaNet  packet  radio  system  for  data  communica¬ 
tions.  As  compelling  as  this  argument  may  be,  it  remains  to  be  seen 
if  this  is  true  when  applied  to  military  operations. 

A  somewhat  different  claim  is  that  the  larger  the  number  of  connec¬ 
tions  in  an  operational  network,  the  more  likely  individual  nodes  will 
experience  “information  overload."  This  is  simply  a  paraphrased 
Parkinson's  Law.  That  is,  if  a  communication  channel  exists  it  is 
likely  to  be  used.  This  too  is  compelling — however,  like  Metcalfs 
Law  it  remains  to  be  seen  if  this  is  the  case  when  applied  to  military 
operation. 

We  might  think  of  these  two  claims  as  extremes  in  a  network  value 
measurement  continuum.  Truth  is  likely  to  be  some  combination  of 
both  expressed  in,  perhaps,  a  new  metric. 

Complexity 

The  issue  centers  on  the  effects  of  relying  on  a  complex  network  to 
conduct  military  operations.  What  are  the  effects  of  complexity?  Are 
there  synergistic  effects  that  can  improve  the  efficiency  of  operations 
beyond  Metcalfs  n^?  Are  there  deleterious  effects  that  reduce  the  ef¬ 
ficiency  on  the  order  of,  say,  More  important,  just  what  do  these 
order-of-magnitude  assessments  mean  when  applied  to  combat  op¬ 
erations?  In  this  work,  we  suggested  a  way  to  assess  both  the  good 
and  bad  effects  of  complexity  with  no  claim  that  our  representations 
are  accurate.  Clearly  more  needs  to  be  done  and  we  suggest  further 
research  in  this  area  in  our  “Next  Steps"  section  below. 
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However,  complexity  alone,  as  defined  by  the  number  of  connec¬ 
tions  in  a  network,  is  clearly  not  enough  to  assess  the  effectiveness  of 
network- centric  operations.  If  it  were,  the  obvious  solution  would  be 
to  return  to  platform- centric  operations.  The  command  and  control 
procedures  implemented  on  the  network  and  the  quality  and  extent 
of  collaboration  also  play  important  roles,  and  we  discuss  them  next. 

Collaboration 

Collaboration  is  expected  to  improve  a  process  by  which  a  team  of 
individuals  works  together  to  achieve  a  common  goal.  Experimenta¬ 
tion  has  verified  that  under  some  circumstances  this  is  indeed  true.^ 
We  have  argued  in  this  report  that  collaboration  is  important  be¬ 
cause  it  can  enhance  the  degree  of  shared  awareness  in  a  group  that 
is  focused  on  solving  a  specific  problem  or  arriving  at  an  agreed  de¬ 
cision.  We  have  also  suggested  that  although  several  reasons  explain 
why  collaboration  might  be  expected  to  improve  the  degree  of 
shared  awareness,  there  may  be  ways  in  which  it  can  degrade  team 
performance.  Capturing  both  effects  in  an  MOP  is  problematic  and 
should  be  the  subject  of  further  research. 

Although,  in  this  work,  we  have  assumed  that  collaboration  is  gen¬ 
erally  beneficial,  we  have  also  recognized  that  it  is  not  uniformly 
beneficial.  The  basic  assumption  means  that  as  the  opportunity  for  a 
decision  team  to  collaborate  increases  (more  connections),  the  bet¬ 
ter  is  the  decision,  whereas  the  variable  benefit  depends  on  the 
quality  of  the  collaboration.  Among  the  several  factors  that  affect  the 
quality  of  collaboration  is  the  knowledge  the  team  members  possess 
about  the  critical  element(s)  of  the  operation.  It  is  this  important 
factor  that  we  focus  on  in  this  research,  and  we  appeal  to  informa¬ 
tion  theory  to  assess  its  impact.  We  have  purposely  ignored  other 
important  effects  on  the  quality  of  collaboration  as  well  as  collabora¬ 
tion  that  degrades  performance.  We  suggest  that  this  is  also  an  area 
for  future  research. 


^See  Perry,  Signori,  and  Boon  (2001). 
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INFORMATION  THEORY 

Information  theory  is  not  just  a  subset  of  communications  theory  as 
some  suggest.2  Rather,  it  contributes  to  several  fields  of  human 
endeavor,  such  as  physics,  computer  science,  statistical  inference, 
philosophy,  economics,  and,  for  our  purposes  more  importantly, 
military  operations.  In  this  work,  we  rely  on  information  theory  to 
assess  the  “amount”  of  knowledge  available  in  a  command  and  con¬ 
trol  system.  To  do  this,  we  apply  the  important  concept  of  informa¬ 
tion  entropy  or  Shannon  entropy.  Where  uncertainty  exists,  infor¬ 
mation  entropy  can  be  assessed — provided  the  uncertainty  can  be 
expressed  as  a  probability  distribution.  The  entropy  measures  the 
amount  of  information  available  in  the  distribution.  We  use  this  to 
make  the  intellectual  leap  to  measuring  the  knowledge  level  about 
the  uncertain  random  variable. 

The  quality  of  collaboration  mentioned  earlier  is  clearly  related  to  the 
knowledge  the  participants  in  the  decision  team  possess  about  the 
uncertain  environment  in  which  they  operate.  It  is  natural  therefore 
to  resort  to  the  knowledge  function,  which  is  derivative  of  informa¬ 
tion  entropy,  to  assess  the  effectiveness  of  the  collaboration  between 
two  decision  team  members.  As  useful  as  this  may  be,  we  recognize 
that  it  remains  to  be  seen  (through  analysis,  experimentation,  and 
simulations)  just  how  true  this  is.  In  addition,  we  also  recognize  that 
the  other  elements  of  collaboration,  those  that  fall  more  in  the  do¬ 
main  of  human  behavior,  need  to  be  included  in  the  overall  assess¬ 
ment.  Experimentation,  analysis,  and  simulations  to  verify  our  cur¬ 
rent  hypothesis  should  also  be  the  subject  of  future  research. 

EXPLORATORY  ANALYSIS  AND  SPREADSHEET  MODELS 

Finally,  we  address  the  use  of  exploratory  analysis  as  the  first  step  in 
evaluating  the  effectiveness  of  the  measures  and  metrics  we  have 
proposed.  Exploratory  analysis  allows  us  to  evaluate  changes  in 
MOEs  that  result  from  modif^ng  the  levels  of  input  variables  using 
visualization  techniques.  This  allows  us  to  better  understand  the 
structure  of  the  data  and  the  complex  relationships  that  exist  be¬ 
tween  the  inputs  and  the  MOEs.  It  is  the  first  step  because  the  tool. 


^See  Cover  and  Thomas  (1991). 
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by  its  nature,  omits  much  of  the  detailed  nuances  present  in  a  high- 
resolution  model. 

The  spreadsheet  models  developed  to  support  this  research  are 
expected-value  models  and  therefore  lack  the  variational  richness 
one  might  expect  from  stochastic  simulations.  The  mathematical 
formulations,  although  apparently  detailed,  are  really  abstractions  of 
the  real  world.  This,  coupled  with  the  expected- vdue  representa¬ 
tion,  lowers  the  level  of  resolution.  This  is  more  than  compensated 
for  by  the  ease  with  which  the  analyst  is  able  to  generate  thousands 
of  alternative  solutions. 

The  exploratory  analysis  visualization  techniques  suggested  in  this 
report  are  by  no  means  exhaustive.  Any  technique,  visual  or  other¬ 
wise,  that  allows  the  analyst  to  sort  the  solutions  quickly  in  some  ra¬ 
tional  way  is  acceptable.  Future  research  should  focus  on  applying 
known  visualization  techniques  and/or  developing  new  ones.  An¬ 
other  step  in  the  process  would  be  to  build  stochastic  models  that 
explore  the  variability  inherent  in  the  two  vignettes. 

NEXT  STEPS 

We  have  stated  repeatedly  that  this  report  is  but  a  small  first  step  in 
the  effort  to  establish  measures  and  metrics  to  connect  C4ISR  and 
network-centric  operations  to  combat  outcomes.  We  have  suggested 
areas  requiring  further  research  throughout  the  text,  and  we  com¬ 
bine  them  here  to  emphasize  their  importance  to  achieving  our 
goals: 

•  Improve  understanding  of  network  complexity  and  better  char¬ 
acterize  its  effects:  This  is  clearly  a  major  undertaking.  Our  as¬ 
sessment  in  this  work  is  essentially  one- dimensional;  complexity 
grows  with  the  number  of  connections.  Its  effects  are  to  both 
degrade  and  enhance  performance.  Although  this  sounds  rea¬ 
sonable,  much  more  of  this  subject  needs  to  be  understood  and 
subsequently  included  in  a  comprehensive  measure  of  per¬ 
formance. 

•  Improve  understanding  of  the  effects  of  collaboration:  We  have 
postulated  that,  like  complexity,  collaboration  can  have  both 
good  and  bad  effects.  Sharing  information  will  likely  improve 
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shared  awareness,  and  shared  awareness  will  likely  improve 
decisionmaking.  However,  what  are  the  bad  effects  of  collabora¬ 
tion  and  how  can  we  capture  them  in  an  MOP? 

•  Examine  ways  to  represent  the  multidimensional  effects  of  col¬ 
laboration:  In  the  TCT  example,  collaboration  was  measured  in 
terms  of  the  knowledge  each  node  had  about  the  time  required 
to  complete  a  task.  Clearly,  other  uncertainties  exist  that  can  be 
reduced  through  collaboration.  Although  these  are  likely  to  be 
situation-specific,  the  methodology  used  to  combine  them 
should  be  universal. 

•  Assess  the  effects  of  information  quality  collaboration:  The 
quality  of  the  information  shared  among  the  participants  in  the 
network  will  likely  have  a  considerable  effect  on  operations. 
How  can  we  measure  accuracy,  completeness,  and  timeliness? 
What  effect  does  this  have  on  the  quality  of  collaboration  and 
how  do  we  measure  it? 


Appendix 

INFORMATION  ENTROPY 


The  following  is  a  detailed  mathematical  development  of  the  infor¬ 
mation  entropy  function  for  the  beta  distribution  used  to  represent 
the  enemy  missile  arrival  rate  within  each  subinterval.  Figure  A.1  is  a 
reproduction  of  Figure  3.10  in  the  main  report. 


THE  BETA  DISTRIBUTION 

The  beta  probability  density  function  is  defined  as  follows: 


with  mean 


E(x)  = 


a 


and  variance 


V{x]  = 


_ oP _ 

(a-i-P)^(a-i-p  +  l) 


For  a  =  p  =  l,  the  well-known  uniform  distribution  results.  For 
a,p  >  1  the  distribution  has  a  mode: 
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Figure  A.1— The  Beta  Probability  Density  Function 


a-1 

a+p-2’ 

For  this  study,  we  consider  only  those  distributions  for  which  a,p  >  1 . 
Figure  A.l  illustrates  the  density  for  various  values  of  a  and  p . 

KNOWLEDGE  CALCULATIONS 

If  we  let  X  =qx  be  the  expected  missile  arrivals  in  the  current  subin¬ 
terval,  where  q  is  the  known  inventory  of  remaining  missiles,  then  x 
is  a  random  variable.  If  we  let  Eix)  =  then  the  expected  value  of 
missUe  arrivals  is  E{X)  =  qE{x)  =  q^.  Since  ^  is  the  actual  fraction  of 
the  remaining  inventory  scheduled  to  be  launched  in  the  current 
subinterval,  we  choose  parameters  of  the  beta  distribution,  a  and  p, 
such  that  a /(a  +  p)  =  However,  because  an  infinite  number  of 
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combinations  of  a  and  p  can  yield  an  unbiased  estimate,  we  choose 
the  appropriate  values  under  the  constraint  that  min(a,  p)  >  1 
(ensuring  that  a  mode  exists)  and  such  that  the  resulting  variance 
achieves  a  target  value  The  target  variance  reflects  the 

information  quality,  Q,  associated  with  the  sensor  suite  used  to 
produce  the  estimate  of  missile  arrival  rate  for  the  current  period. 

For  purposes  of  this  discussion,  information  quality  is  the  degree  to 
which  the  information  is  current,  correct,  and  complete.  Therefore, 
we  set  0  <  Q  <  1,  where  Q=l  implies  the  information  has  maximum 
quality.^ 


Target  Variance 

We  let  the  target  variance,  Vo(x),  be  the  largest  attainable  variance 
given  our  constraints.  That  is,  Vq^x)  represents  the  maximum- 
uncertainty  case.  We  can  then  develop  a  beta  distribution  with  mean 
^  and  variance  Vb  W  and  associate  it  with  Q  =  0  (a  large  variance  im¬ 
plies  low  quality).  We  further  let  Viix)  be  the  minimum  variance. 
Viix]  then  is  associated  with  Q  =  1.  We  now  choose  a  scalar,  k>l,  so 
that  VbW  =  kViix).  From  this,  we  can  derive  the  variance,  Vq(x),  for 
any  level  of  information  quality,  Q,  as  follows: 


Vq(.x)=  KoW+Q(v^iW-1'oW) 


r 

=  VoM+Q  ■ 
V 


Vpix) 

k 


=  Vo(x) 


1+Q 


If  ao,Po  are  the  parameter  values  that  yield  the  largest  possible 
variance,  Vb(x)  whose  mean  is 


cxq 

ao  +  Po 


ipor  a  more  complete  discussion  of  information  quality,  see  Perry,  Signori,  and  Boon 
(2001). 
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we  can  use  the  preceding  result  to  find  the  parameters  aQ,PQ  >  1  for 
all  values  of  Q  and  the  true  enemy  missile  arrival  proportion,  ^ .  Fig¬ 
ure  A.2  illustrates  the  linear  relationship. 


Theorems 

Before  proceeding,  we  develop  some  important  theorems. 
Theorem  1:  (a)  If 


VqM 

Voix) 


represents  the  target  reduction  in  variance  achieved  by  a  specified 
level  of  sensor  information  quality,  Q,  and  (b)  if  the  original  beta 
distribution  with  variance,  V^ix],  and  mean,  has  parameters  a  and 


Figure  A-2 — ^Attack  Distribution  Variance  from  VqW  and  ViU) 
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p,  then  the  target  beta  distribution  has  parameters  a'  =  ba  and 
P'  =  5p,  where 


Proof:  Solving 


a 

a  +  p 


=  5 


for  p,  we  get 


Since 


p  =  a 


g-^) 


p=^, 

^  Voix)’ 

for  specified  values  ofk  and  Q,  we  get  the  following: 


Vq(:v:)_  a'|3'  ^  (a+p)^(a+P+l) 

V^oW~(a'+p')2(a'+p'+l)  “P 

8a5p  ^(a+p)V+p+l) 

(8a+8P)2(5a+8p+l)  «P 

8^aP  ^(a+P)^(a+p+l) 

82(a+p)^(8a+8P+l)  “P 

g+P+l 
8a+8p+l‘ 
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Solving  for  8  we  get  the  desired  result: 


a 


Theorem  2:  Rescaling  both  parameters  of  a  beta  distribution  by  a 
constant,  8  >  1,  will  leave  the  expected  value  unchanged  but  will  de¬ 
crease  the  variance  of  the  resulting  distribution. 

Proof:  If  the  parameters  are  a,p>l  and  we  let  parameters  of  the 
scaled  distribution  be  a'  =  8a  and  p'  =  8p,  where  8  >  1,  the  expected 
value  of  the  scaled  distribution  is: 

E(x:a'3')  =  ~^  =  -^  = 

a'+P'  8a  +  8p  8(a+p)  a+p 

For  the  variance,  construct  the  ratio: 


V(X:a',P0  g'p'  ^(a+P)^(a+P+l) 

V(X;a,p)  (a'+P')^(a'+P'+l)  ap 

_ _ 6^«P _ _(a+P)^(a+p+l) 

5^(a+p)2(5a+5p+l)  “P 


g+p-El 

8a+8p+l 


<  1  whenever  8  >  1. 


From  this  we  have  that 


Vix:a',P') 

V(x:a,p) 

and  therefore  V(x:a' ,  P';  <  V(x:a,  p 

Corollary  2a:  Rescaling  both  parameters  of  a  beta  distribution  by  a 
constant,  8  =  i,  will  leave  the  expected  value  and  variance  of  the  re¬ 
sulting  distribution  unchanged. 
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Proof:  //  6  =1,  then  a'  =  a  and  p'  =  p,  the  distribution  and  its 
central  moments  are  unaffected. 

Corollary  2b:  Rescaling  both  parameters  of  a  beta  distribution  by  a 
constant,  6  <  1,  will  leave  the  expected  value  unchanged  and  increase 
the  variance  of  the  resulting  distribution. 

Proof:  Let  a'  =  6a  and  p'  =  5p,  where  b  <1.  By  theorem  2,  the  ex¬ 
pected  value  of  the  scaled  distribution  remains  unchanged.  Also  from 
the  proof  of  theorem  2,  we  get: 


+  ,i^henever6<l. 

y(X;a,p)  (8a  +  8p+l) 


Therefore  V(x:a',?f')  >  V(x:a,  pj. 

Theorem  3:  For  a  beta  distribution  with  parameters  a',  p'  and  mean 
E(x)  =  5  and  with  the  condition  that  min  (a' ,P')  >  I,  the  largest 
attainable  variance  is  achieved  by  setting  a'  -  1  if  ^  <  0.5  and  setting 
p'  =  n7^>0.5. 

Proof:  From  corollaries  2a  and  2b,  we  maximize  the  variance  by 
rescaling  the  parameters  of  a  beta  distribution  with  parameters 
a,  p  >1  by  a  constant  6  <  1 .  The  constraint  that  minra',  p'J  >  1 
implies  that  the  largest  constrained  variance  occurs  when 
mm(a',  p'j  =  1.  If 


we  must  have  that  p'  <  a'.  This  can  occur  only  when  p'  =  1.  Simi¬ 
larly,  for 


a' 

a'  +  p' 


<0.5, 


we  must  have  that  P'  >  a'.  Consequently  we  must  have  a'  =  1. 
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Calculating  Parameters  for  Maximum  Uncertainty 

We  now  use  the  theorems  to  calculate  the  parameters,  ao,Po  ^1^  as¬ 
sociated  with  the  maximum  uncertainty  distribution.  We  first  calcu¬ 
late  the  maximum  variance,  Vo(x).  We  have  that 


ap+Po 


Based  on  theorem  3,  this  can  be  accomplished  by  setting  either 
tto  =  1  or  po  =  1  depending  on  the  value  of  ^ : 


If  5  ^  0.5  then  set  ao  =  1  and  solve  for 


Pp  = 


kA 

^  ‘ 


If  ^  >  0.5  then  set  pg  =  1  and  solve  for 


The  target  variance  parameters  are  now  calculated  to  be  Oq  =6ao 
and  Pq  =3po,  for  some  5  >  1  (resulting  in  a  lower  variance  as  shown 
in  theorem  2).  With  this,  we  employ  theorem  1  to  solve  for  the  new 
parameter  values,  Oq  and  pQ. 

Entropy  for  the  Beta  Distribution 

Entropy  for  the  beta  distribution  with  parameters  a  and  p  is  calcu¬ 
lated  to  be:  2 


^See  Cover  and  Thomas  (1991). 
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Hix)  =  -  f  fix)\nf{x)dx 
Jx=0 

=  ln[5(a,p)]  -  (a  ~  1)  -  \|/(a + p)]  -  (P  - 1)  [\i/(p)  -  y(a  +  p)]. 

where  \}/(c)  is  the  first  derivative  of  Euler’s  gamma,  and 


TipWiq) 
T[p+q)  ’ 


We  can  create  a  mapping  of  entropy  onto  a  [0,1]  knowledge  scale  by 
selecting  an  upper  bound  on  the  entropy  associated  with  the  fraction 
X.  Before  proceeding,  however,  we  note  that  the  uncertainty  as¬ 
sociated  with  the  fraction  of  the  remaining  missiles  arriving  in  the 
current  subinterval  is  equivalent  to  the  uncertainty  associated  with 
the  actual  arrival  rate,  X,oiHiX)  =  Hix) . 

The  upper  bound  for  HiX],  denoted  IP{X),  occurs  when  a  =  p  =  1. 
That  is,  maximum  entropy  occurs  when  uncertainty  is  maximized. 
In  this  case,  therefore,  we  have  that  H*{X)  =  0,  a  natural  upper 
bound.  A  lower  bound  is  also  needed.  However,  minimum  entropy 
occurs  when  the  variance  is  minimized  or  when  a  and  p  are  very 
large  so  that  H{X)  ->  -«>.  For  practical  purposes,  we  set  this  to  be 
a  =  p  =  12,  for  which  HiX)  =  -32.3192.  We  can  define  knowledge 
therefore  as: 


.  mx)-H^in{X)  _  HiX)  _  mx) 

-32.3192‘ 


Implementation 

For  the  exploratory  analysis  tool  discussed  in  Chapter  Five,  a  value  of 
k  =  8.333  was  selected  for  the  equation  Vq{x)  =  kViix).  The  value  of  k 
was  determined  to  be  the  ratio  of  the  variance  of  a  beta(l,l)  to  a 
beta(12,12)  distribution.  Based  on  that,  we  also  set  H*{  X)  =  -32.3192 
which  corresponds  to  the  same  symmetric  beta(12,12)  distribution. 
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Numerical  Approximation  of  Euler’s  Gamma 

The  following  code  can  compute  an  approximation  to  Euler’s  gamma 
accurate  to  10  decimal  places: 

function  psiU) 

jc  =  jc  +  6; 

p  =  i/x^: 

p  =  0.004166666666667^4  _  0.003968253986254p3  + 
0.008333333333333^2  -  0.83333333333333p: 

p  =  ;7  +  ln{A:)-(0.5/x)-l/(jc-l)-l/(j:-2)-l/(x-3)-l/(x-4)- 
l/(jc-5)-l/(x-6); 

P  =  -p: 

return  (p); 

end; 

Successive  calls  to  this  function  for  x  =  \,2, ...  ,  12  yield  the  results 
reported  in  Table  A.l.  These  values  were  used  in  the  exploratory 
analysis  model  described  in  Chapter  Five. 
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Table  A.  1 

Euler's  Gamma 


X 

¥  W 

1 

0.5772156649 

2 

-0.4227843351 

3 

-0.9227843351 

4 

-1.2561176684 

5 

-1.5061176684 

6 

-1.7061176684 

7 

-1.8727843351 

8 

-2.0156414780 

9 

-2.1406414780 

10 

-2.2517525891 

11 

-2.3517525891 

12 

-2.4426616800 

13 

-2.5259950133 

14 

-2.6029180902 

15 

-2.6743466617 

16 

-2.7410133283 

17 

-2.8035133283 

18 

-2.8623368577 

19 

-2.9178924133 

20 

-2.9705239922 

21 

-3.0205239922 

22 

-3.0681430399 

23 

-3.1135975853 

24 

-3.1570758462 

25 

-3.1987425129 

26 

-3.2387425129 

27 

-3.2772040513 

28 

-3.3142410884 
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In  military  operations,  information  has  always  been  every  bit  as  vital  as  fuel 
or  ammunition  in  achieving  favorable  outcomes.  Today,  the  need  to  reduce 
decision  timelines  highlights  its  importance.  The  Navy  postulates  that  network¬ 
centric  operations  will  enhance  the  effectiveness  of  combat  systems  by  allowing 
commanders  to  mass  effects  from  great  distances.  At  issue  is  verification  of  this 
assumption.  How  can  the  effectiveness  of  network-centric  information  systems  be 
linked  to  combat  outcomes?  The  authors  seek  to  identify  how  information  affects 
outcomes  and  determine  how  to  measure  the  link  between  the  two.  This  report 
creates  a  framework  for  developing  measures  to  help  the  Navy  decide  how 
network-centric  operations  affect  combat  outcomes  and  which  information  systems 
work  best.  The  authors  demonstrate  a  proof-of-concept  tool  that  can  generate 
several  alternative  network-centric  command,  control,  communications,  computer, 
intelligence,  surveillance,  and  reconnaissance  systems.  Using  a  spreadsheet  model, 
they  take  the  first  steps  toward  developing  formulas  to  help  the  Navy  codify  an 
approach  to  measuring  combat  effectiveness  in  network-centric  operations. 
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